2024-09-16T03:53:26.667 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T03:53:26.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T03:53:26.769 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958 branch: squid description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} email: ceph-qa@ceph.com first_in_suite: false job_id: '7905958' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 osd_object_clean_region_max_num_intervals: 1000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.1 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - slow request - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 700 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 5616 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 15927/100000 suite: rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzy5nHHYBwdb93Y8Akf6FbnWQT7XNsoW7i67tDQly6TmtV0msMEGTuAFS6i+lBUz0iV34OJ7BAYsoNw+6H3UhY= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8hWYK1MOwXxbvoHqM/fBVyfjzbPDDcqt8EVUSdi/gMKg4/gqeSlCf6uXewITuBsWYT29Kz2Qxhr8l5IbpYJYs= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEk0FPI4TClcXZmkRdJdARY7SjQ3wE4i6iIiRIapX2Zo82P61yAv8E5nk/kP38GCEHvnCCuQTZpHIQv7SPjU4Ok= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7kq/BoonxSy0N+Ht7arvf20m4kdHMOiahNFjT6wy+MY/0NFrk2wbjgE7pmQBPa4APM2/gDsMvWJ+aWcCvmR0c= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: bluestore_new_sharding: random chance_bluestore_reshard: 1 chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 8 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: c: 2 crush-failure-domain: osd k: 4 m: 3 name: shecprofile plugin: shec objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T03:53:26.770 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T03:53:26.770 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T03:53:26.770 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T03:53:26.772 INFO:teuthology.task.internal:Checking packages... 2024-09-16T03:53:26.797 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T03:53:26.797 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T03:53:26.797 INFO:teuthology.packaging:ref: None 2024-09-16T03:53:26.797 INFO:teuthology.packaging:tag: None 2024-09-16T03:53:26.797 INFO:teuthology.packaging:branch: squid 2024-09-16T03:53:26.797 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T03:53:26.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-16T03:53:27.001 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-16T03:53:27.003 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T03:53:27.010 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T03:53:27.011 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T03:53:27.025 INFO:teuthology.task.internal:Saving configuration 2024-09-16T03:53:27.042 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T03:53:27.054 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T03:53:27.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:47:40.318794', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEgwNAYQlVEzhdO0Rhsa0RytDucVo+x70WFDdQK6kfDI'} 2024-09-16T03:53:27.094 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:47:40.319910', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK4jPwwMODTSZdo+y57H+eU69aRf5ZmlKQ/gPsmmaacx'} 2024-09-16T03:53:27.113 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:47:40.315929', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOZZADJVBqNcwQXBNqaXtaWRjUzRAXziqpLxnU3CIYSw'} 2024-09-16T03:53:27.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:47:40.317679', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYGvszX/AVTIkxdFm1Bd99/A8YAC2fjjX6E4BiWAw7b'} 2024-09-16T03:53:27.139 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T03:53:27.147 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-09-16T03:53:27.147 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-09-16T03:53:27.147 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-09-16T03:53:27.148 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-09-16T03:53:27.148 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T03:53:27.307 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa443fe6e60>, signals=[15]) 2024-09-16T03:53:27.307 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T03:53:27.319 INFO:teuthology.task.internal:Opening connections... 2024-09-16T03:53:27.319 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T03:53:27.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:53:27.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T03:53:27.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:53:27.486 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T03:53:27.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:53:27.566 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T03:53:27.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:53:27.651 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T03:53:27.657 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-09-16T03:53:27.664 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-09-16T03:53:27.664 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-09-16T03:53:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T03:53:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-09-16T03:53:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-09-16T03:53:27.709 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T03:53:27.710 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-09-16T03:53:27.711 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-09-16T03:53:27.733 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-16T03:53:27.740 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-16T03:53:27.740 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-16T03:53:27.787 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T03:53:27.787 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-09-16T03:53:27.787 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T03:53:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2024-09-16T03:53:27.789 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-16T03:53:27.816 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-09-16T03:53:27.822 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-09-16T03:53:27.822 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-09-16T03:53:27.871 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T03:53:27.871 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-09-16T03:53:27.871 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-09-16T03:53:27.871 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T03:53:27.871 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-09-16T03:53:27.871 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-09-16T03:53:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-09-16T03:53:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T03:53:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T03:53:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T03:53:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T03:53:27.872 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-09-16T03:53:27.872 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-09-16T03:53:27.891 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-09-16T03:53:27.898 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-09-16T03:53:27.898 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-09-16T03:53:27.945 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T03:53:27.945 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2024-09-16T03:53:27.945 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04" 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T03:53:27.946 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy 2024-09-16T03:53:27.946 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-09-16T03:53:27.975 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T03:53:27.986 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T03:53:28.003 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T03:53:28.003 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:53:28.006 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:53:28.009 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:53:28.011 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:53:28.016 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T03:53:28.024 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T03:53:28.024 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:53:28.054 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:53:28.057 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:53:28.060 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:53:28.071 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T03:53:28.171 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T03:53:28.188 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T03:53:28.188 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T03:53:28.189 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:53:28.189 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:53:28.190 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:53:28.190 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:53:28.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:53:28.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:53:28.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:53:28.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:53:28.199 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-09-16T03:53:28.199 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-16T03:53:28.200 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-16T03:53:28.200 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-16T03:53:28.241 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-56-generic 2024-09-16T03:53:28.241 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.15.0-56-generic 2024-09-16T03:53:28.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-09-16T03:53:28.243 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-56-generic 2024-09-16T03:53:28.244 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.15.0-56-generic 2024-09-16T03:53:28.244 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2024-09-16T03:53:28.247 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-56-generic 2024-09-16T03:53:28.247 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.15.0-56-generic 2024-09-16T03:53:28.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-09-16T03:53:28.249 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-56-generic 2024-09-16T03:53:28.249 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.15.0-56-generic 2024-09-16T03:53:28.249 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-09-16T03:53:28.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-16T03:53:28.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-16T03:53:28.387 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-09-16T03:53:28.393 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-09-16T03:53:28.540 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T03:53:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:53:28.669 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:53:28.669 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T03:53:28.681 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:53:28.681 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T03:53:28.716 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T03:53:28.731 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T03:53:28.734 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T03:53:28.746 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T03:53:28.807 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:53:28.808 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T03:53:28.809 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T03:53:28.820 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T03:53:28.859 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T03:53:28.861 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T03:53:28.862 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T03:53:28.862 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T03:53:28.881 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T03:53:28.884 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T03:53:28.884 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T03:53:28.889 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T03:53:28.893 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T03:53:28.894 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T03:53:28.896 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T03:53:28.896 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T03:53:28.896 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T03:53:28.913 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T03:53:29.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T03:53:29.088 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T03:53:29.088 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T03:53:29.090 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T03:53:29.105 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T03:53:29.107 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T03:53:29.122 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T03:53:29.209 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T03:53:29.226 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T03:53:29.227 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T03:53:29.229 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T03:53:29.414 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T03:53:29.430 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T03:53:29.435 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T03:53:29.526 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T03:53:29.528 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T03:53:29.542 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T03:53:29.542 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T03:53:29.544 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T03:53:29.544 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T03:53:29.551 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T03:53:29.551 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T03:53:29.553 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T03:53:29.553 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T03:53:29.553 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T03:53:29.555 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T03:53:29.558 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T03:53:29.563 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T03:53:29.567 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T03:53:29.567 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T03:53:29.569 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T03:53:29.577 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T03:53:29.578 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T03:53:29.579 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T03:53:29.579 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T03:53:29.580 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T03:53:29.584 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T03:53:29.593 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T03:53:29.594 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T03:53:29.594 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T03:53:29.594 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T03:53:29.595 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T03:53:29.596 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T03:53:29.598 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T03:53:29.599 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T03:53:29.600 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T03:53:29.648 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T03:53:29.649 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T03:53:29.660 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T03:53:29.664 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T03:53:29.665 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T03:53:29.669 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T03:53:29.669 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T03:53:29.670 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T03:53:29.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T03:53:29.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T03:53:29.676 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T03:53:29.679 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T03:53:29.680 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T03:53:29.680 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T03:53:29.681 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T03:53:29.681 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T03:53:29.698 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T03:53:29.698 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T03:53:29.699 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T03:53:29.703 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T03:53:29.704 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T03:53:29.707 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T03:53:29.711 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T03:53:29.713 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T03:53:29.714 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T03:53:29.715 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T03:53:29.715 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T03:53:29.716 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T03:53:29.716 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T03:53:29.717 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T03:53:29.720 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T03:53:29.725 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T03:53:29.728 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T03:53:29.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T03:53:29.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T03:53:29.731 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T03:53:29.731 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T03:53:29.731 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T03:53:29.732 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T03:53:29.732 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T03:53:29.734 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T03:53:29.736 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T03:53:29.737 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T03:53:29.737 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T03:53:29.737 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T03:53:29.738 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T03:53:29.738 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T03:53:29.739 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T03:53:29.740 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T03:53:29.741 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T03:53:29.744 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T03:53:29.744 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T03:53:29.744 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T03:53:29.745 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T03:53:29.748 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T03:53:29.748 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T03:53:29.749 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T03:53:29.750 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T03:53:29.750 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T03:53:29.754 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T03:53:29.755 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T03:53:29.756 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T03:53:29.756 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T03:53:29.787 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T03:53:29.791 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T03:53:29.792 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T03:53:29.792 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T03:53:29.792 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T03:53:29.792 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T03:53:29.808 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T03:53:29.809 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T03:53:29.809 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T03:53:29.811 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T03:53:29.812 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T03:53:29.819 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T03:53:29.820 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T03:53:29.821 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T03:53:29.823 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T03:53:29.823 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T03:53:29.824 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T03:53:29.825 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T03:53:29.833 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T03:53:29.833 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T03:53:29.834 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T03:53:29.835 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T03:53:29.872 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T03:53:29.872 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T03:53:29.872 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T03:53:29.873 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T03:53:29.873 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T03:53:29.890 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T03:53:29.893 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T03:53:29.894 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T03:53:29.895 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T03:53:29.897 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T03:53:29.906 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T03:53:29.907 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T03:53:29.915 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T03:53:29.915 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T03:53:29.916 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T03:53:29.916 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T03:53:29.917 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T03:53:35.031 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 16.0 MB in 2s (7,512 kB/s) 2024-09-16T03:53:35.788 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 16.0 MB in 3s (5,908 kB/s) 2024-09-16T03:53:36.035 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 16.0 MB in 3s (5,676 kB/s) 2024-09-16T03:53:36.150 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 16.0 MB in 3s (5,672 kB/s) 2024-09-16T03:53:36.487 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-16T03:53:36.505 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:53:36.564 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-16T03:53:36.773 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-16T03:53:36.774 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-16T03:53:36.957 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:53:36.957 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:53:36.957 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:53:36.958 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:53:36.958 INFO:teuthology.orchestra.run.smithi204.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T03:53:36.958 INFO:teuthology.orchestra.run.smithi204.stdout: python2.7-minimal 2024-09-16T03:53:36.958 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:53:36.959 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-09-16T03:53:36.959 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:36.959 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T03:53:36.960 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:36.961 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-09-16T03:53:36.961 INFO:teuthology.orchestra.run.smithi204.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T03:53:36.961 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2024-09-16T03:53:36.961 INFO:teuthology.orchestra.run.smithi204.stdout: thermald 2024-09-16T03:53:37.013 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-09-16T03:53:37.013 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:37.013 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T03:53:37.013 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:37.014 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2024-09-16T03:53:37.015 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T03:53:37.065 INFO:teuthology.orchestra.run.smithi204.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:53:37.065 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 113 MB of archives. 2024-09-16T03:53:37.066 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T03:53:37.066 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T03:53:37.329 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-16T03:53:37.346 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:53:37.401 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-16T03:53:37.517 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T03:53:37.585 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-16T03:53:37.586 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-16T03:53:37.587 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-16T03:53:37.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:53:37.607 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T03:53:37.613 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-16T03:53:37.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:53:37.671 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-16T03:53:37.685 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-16T03:53:37.755 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:53:37.756 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:53:37.756 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:53:37.756 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:53:37.756 INFO:teuthology.orchestra.run.smithi196.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T03:53:37.756 INFO:teuthology.orchestra.run.smithi196.stdout: python2.7-minimal 2024-09-16T03:53:37.756 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:53:37.757 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-09-16T03:53:37.758 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:37.758 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T03:53:37.758 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:37.759 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-09-16T03:53:37.759 INFO:teuthology.orchestra.run.smithi196.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T03:53:37.759 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-09-16T03:53:37.759 INFO:teuthology.orchestra.run.smithi196.stdout: thermald 2024-09-16T03:53:37.811 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-09-16T03:53:37.812 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:37.812 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T03:53:37.812 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:37.813 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-09-16T03:53:37.814 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T03:53:37.883 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-16T03:53:37.883 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-16T03:53:37.886 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-16T03:53:37.887 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-16T03:53:37.994 INFO:teuthology.orchestra.run.smithi196.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:53:37.994 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 113 MB of archives. 2024-09-16T03:53:37.994 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T03:53:37.994 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T03:53:38.061 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:53:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:53:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:53:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:53:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T03:53:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: python2.7-minimal 2024-09-16T03:53:38.062 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:53:38.063 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-16T03:53:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T03:53:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:38.065 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-16T03:53:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T03:53:38.065 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-16T03:53:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2024-09-16T03:53:38.084 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:53:38.084 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:53:38.084 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:53:38.085 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:53:38.085 INFO:teuthology.orchestra.run.smithi032.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T03:53:38.085 INFO:teuthology.orchestra.run.smithi032.stdout: python2.7-minimal 2024-09-16T03:53:38.085 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:53:38.086 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-16T03:53:38.086 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:38.087 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T03:53:38.087 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:38.088 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-16T03:53:38.088 INFO:teuthology.orchestra.run.smithi032.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T03:53:38.088 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-16T03:53:38.089 INFO:teuthology.orchestra.run.smithi032.stdout: thermald 2024-09-16T03:53:38.117 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-16T03:53:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T03:53:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:38.118 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-09-16T03:53:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T03:53:38.130 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-16T03:53:38.130 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T03:53:38.131 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T03:53:38.131 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T03:53:38.133 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-09-16T03:53:38.133 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T03:53:38.186 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:53:38.186 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 113 MB of archives. 2024-09-16T03:53:38.186 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T03:53:38.186 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T03:53:38.299 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:53:38.299 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 113 MB of archives. 2024-09-16T03:53:38.299 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T03:53:38.299 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T03:53:38.437 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T03:53:38.437 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T03:53:38.437 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T03:53:38.563 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T03:53:38.584 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T03:53:38.656 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T03:53:38.770 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T03:53:38.969 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 113 MB in 2s (72.5 MB/s) 2024-09-16T03:53:39.144 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T03:53:39.417 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T03:53:39.607 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T03:53:39.607 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T03:53:39.607 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T03:53:39.713 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T03:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T03:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T03:53:39.769 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T03:53:40.068 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T03:53:40.171 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 113 MB in 2s (70.0 MB/s) 2024-09-16T03:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T03:53:41.191 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T03:53:41.195 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:41.249 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:41.993 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T03:53:41.994 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T03:53:41.994 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T03:53:42.323 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T03:53:42.323 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T03:53:42.323 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T03:53:42.359 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T03:53:42.390 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T03:53:42.395 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:42.441 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T03:53:42.495 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:42.670 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T03:53:42.750 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T03:53:42.851 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-16T03:53:43.042 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T03:53:43.160 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-16T03:53:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T03:53:43.409 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T03:53:43.433 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:43.524 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:43.988 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T03:53:44.008 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:44.046 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:44.956 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T03:53:44.960 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:45.022 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:45.131 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T03:53:45.153 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:45.253 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:45.387 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T03:53:45.392 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:45.462 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:45.726 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T03:53:45.747 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:45.784 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:47.448 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T03:53:47.469 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:47.543 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:47.838 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T03:53:47.859 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:47.956 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:48.001 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T03:53:48.021 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:48.059 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:48.483 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T03:53:48.503 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:48.532 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:51.098 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:51.216 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:51.557 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:51.678 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:51.947 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T03:53:51.970 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T03:53:52.022 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:53:52.106 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:52.208 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:52.525 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:52.653 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:52.957 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T03:53:52.979 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T03:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:53:54.374 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:54.509 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:54.717 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:54.825 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:54.842 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:54.940 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:55.185 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:53:55.226 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T03:53:55.237 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T03:53:55.276 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:53:55.312 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:53:55.607 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T03:53:55.626 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T03:53:55.657 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:53:57.987 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T03:53:58.025 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:58.062 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:53:58.836 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T03:53:58.873 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:53:58.911 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:00.643 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T03:54:00.680 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:54:00.716 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:54:00.718 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:00.841 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:54:00.848 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T03:54:00.887 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T03:54:00.931 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:01.175 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:54:01.271 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:01.422 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T03:54:01.550 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:01.772 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:54:01.897 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:54:02.256 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:54:02.377 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T03:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:02.848 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:02.848 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:02.849 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:02.849 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:03.004 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:03.823 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:54:04.082 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:04.082 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:04.082 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:04.082 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:54:04.838 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:04.842 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:04.993 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T03:54:05.117 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T03:54:05.121 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:54:05.243 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:05.369 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T03:54:05.468 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T03:54:05.497 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:05.564 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:05.690 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T03:54:05.826 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:06.231 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T03:54:06.358 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T03:54:06.484 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:06.556 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T03:54:06.556 INFO:teuthology.orchestra.run.smithi204.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:06.635 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:06.824 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:06.824 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:06.824 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:06.824 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:06.966 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:07.187 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:07.346 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T03:54:08.203 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T03:54:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:08.375 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:08.395 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T03:54:08.395 INFO:teuthology.orchestra.run.smithi032.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:08.788 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:10.486 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T03:54:10.688 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T03:54:10.789 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:10.846 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T03:54:10.846 INFO:teuthology.orchestra.run.smithi196.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:10.982 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T03:54:11.108 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T03:54:11.234 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T03:54:11.301 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T03:54:11.301 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:21.280 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T03:54:21.280 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub' 2024-09-16T03:54:21.288 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:21.304 INFO:teuthology.orchestra.run.smithi204.stdout:Generating grub configuration file ... 2024-09-16T03:54:21.583 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:21.606 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:21.893 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:21.899 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:21.968 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:21.974 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:22.134 INFO:teuthology.orchestra.run.smithi204.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:22.134 INFO:teuthology.orchestra.run.smithi204.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:22.134 INFO:teuthology.orchestra.run.smithi204.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:22.177 INFO:teuthology.orchestra.run.smithi204.stdout:done 2024-09-16T03:54:22.668 DEBUG:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2024-09-16T03:54:22.691 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2024-09-16T03:54:22.691 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2024-09-16T03:54:22.691 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2024-09-16T03:54:22.691 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2024-09-16T03:54:22.691 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 21 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:22.692 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2024-09-16T03:54:22.692 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T03:54:22.693 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:54:22.693 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:54:22.693 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T03:54:22.693 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:54:22.693 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2024-09-16T03:54:22.859 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T03:54:22.859 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub' 2024-09-16T03:54:22.869 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:22.880 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-09-16T03:54:22.885 INFO:teuthology.orchestra.run.smithi032.stdout:Generating grub configuration file ... 2024-09-16T03:54:22.999 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:54:22.999 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:54:23.009 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:54:23.026 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:54:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:23.268 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:23.574 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:23.580 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:23.654 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:23.660 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:23.843 INFO:teuthology.orchestra.run.smithi032.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:23.843 INFO:teuthology.orchestra.run.smithi032.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:23.843 INFO:teuthology.orchestra.run.smithi032.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:23.880 INFO:teuthology.orchestra.run.smithi032.stdout:done 2024-09-16T03:54:24.336 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-09-16T03:54:24.356 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-09-16T03:54:24.356 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-09-16T03:54:24.356 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-09-16T03:54:24.356 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:24.357 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-09-16T03:54:24.357 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T03:54:24.358 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:54:24.358 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:54:24.358 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T03:54:24.358 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:54:24.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-09-16T03:54:24.413 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-16T03:54:24.432 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:54:24.493 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-16T03:54:24.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-16T03:54:24.657 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:54:24.707 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-16T03:54:24.707 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-16T03:54:24.785 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:54:24.858 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:54:24.882 INFO:teuthology.orchestra.run.smithi204.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:54:24.883 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:54:24.923 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:54:24.926 DEBUG:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2024-09-16T03:54:24.930 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T03:54:24.930 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub' 2024-09-16T03:54:24.939 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:54:24.940 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:24.942 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2024-09-16T03:54:24.942 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2024-09-16T03:54:24.942 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2024-09-16T03:54:24.942 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2024-09-16T03:54:24.942 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 21 2024-09-16T03:54:24.942 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:24.943 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2024-09-16T03:54:24.944 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-16T03:54:24.966 INFO:teuthology.orchestra.run.smithi196.stdout:Generating grub configuration file ... 2024-09-16T03:54:24.993 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.Vqpb0kKI9q 2024-09-16T03:54:24.993 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Vqpb0kKI9q 2024-09-16T03:54:25.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.Vqpb0kKI9q 2024-09-16T03:54:25.171 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.Vqpb0kKI9q is 10KB 2024-09-16T03:54:25.184 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.Vqpb0kKI9q 2024-09-16T03:54:25.190 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:25.232 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:25.245 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T03:54:25.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T03:54:25.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:25.256 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:25.312 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T03:54:25.312 DEBUG:teuthology.orchestra.run.smithi204:> sudo update-grub 2024-09-16T03:54:25.546 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:25.551 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T03:54:25.551 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2024-09-16T03:54:25.551 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:25.560 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:25.585 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2024-09-16T03:54:25.625 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:25.631 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:25.783 INFO:teuthology.orchestra.run.smithi196.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:25.784 INFO:teuthology.orchestra.run.smithi196.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:25.784 INFO:teuthology.orchestra.run.smithi196.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:25.824 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-09-16T03:54:25.939 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:25.960 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-16T03:54:26.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-16T03:54:26.279 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-09-16T03:54:26.306 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:26.307 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-09-16T03:54:26.307 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T03:54:26.307 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:54:26.307 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:54:26.307 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-16T03:54:26.308 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:54:26.308 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-09-16T03:54:26.316 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:26.321 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:26.395 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:26.400 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:26.427 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-16T03:54:26.428 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-16T03:54:26.477 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-09-16T03:54:26.565 INFO:teuthology.orchestra.run.smithi050.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:26.565 INFO:teuthology.orchestra.run.smithi050.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:26.565 INFO:teuthology.orchestra.run.smithi050.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:26.589 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub' 2024-09-16T03:54:26.591 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:26.593 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-09-16T03:54:26.594 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:54:26.594 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:54:26.603 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:54:26.604 INFO:teuthology.orchestra.run.smithi032.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T03:54:26.604 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:54:26.604 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:54:26.605 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:54:26.605 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:54:26.606 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-09-16T03:54:26.606 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:54:26.606 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:54:26.606 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:54:26.620 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:54:26.645 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:54:26.647 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-09-16T03:54:26.664 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-09-16T03:54:26.664 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-09-16T03:54:26.664 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-09-16T03:54:26.664 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-09-16T03:54:26.665 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-09-16T03:54:26.665 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:26.665 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-09-16T03:54:26.665 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-09-16T03:54:26.665 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:26.666 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:26.666 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:26.666 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-09-16T03:54:26.666 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:26.666 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:26.666 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-09-16T03:54:26.667 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-16T03:54:26.712 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.6Hub07TRbZ 2024-09-16T03:54:26.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6Hub07TRbZ 2024-09-16T03:54:26.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.6Hub07TRbZ 2024-09-16T03:54:26.781 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:26.786 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:26.883 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.6Hub07TRbZ is 10KB 2024-09-16T03:54:26.896 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.6Hub07TRbZ 2024-09-16T03:54:26.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:26.956 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T03:54:26.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T03:54:26.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:27.012 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:27.016 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:27.027 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T03:54:27.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo update-grub 2024-09-16T03:54:27.055 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:27.061 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:27.126 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-09-16T03:54:27.192 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:27.193 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:27.193 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:27.193 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-09-16T03:54:27.193 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:27.193 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:27.193 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-09-16T03:54:27.193 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T03:54:27.193 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:54:27.193 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:54:27.193 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-16T03:54:27.193 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:54:27.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-09-16T03:54:27.205 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:27.206 INFO:teuthology.orchestra.run.smithi204.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:27.206 INFO:teuthology.orchestra.run.smithi204.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:27.228 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-09-16T03:54:27.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-09-16T03:54:27.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-16T03:54:27.504 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T03:54:27.624 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T03:54:27.709 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T03:54:27.787 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T03:54:28.031 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-16T03:54:28.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:54:28.139 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-16T03:54:28.254 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-09-16T03:54:28.255 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:28.258 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-09-16T03:54:28.348 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-16T03:54:28.349 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-16T03:54:28.448 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:28.454 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:28.541 INFO:teuthology.orchestra.run.smithi196.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T03:54:28.541 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:54:28.541 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:54:28.541 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:54:28.541 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:54:28.541 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:54:28.542 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:54:28.542 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:54:28.584 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:54:28.586 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-09-16T03:54:28.601 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-09-16T03:54:28.601 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-09-16T03:54:28.601 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-09-16T03:54:28.601 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:28.602 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-09-16T03:54:28.603 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-09-16T03:54:28.649 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.m0Q5tc21e5 2024-09-16T03:54:28.649 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.m0Q5tc21e5 2024-09-16T03:54:28.714 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.m0Q5tc21e5 2024-09-16T03:54:28.753 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:28.758 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:28.800 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:28.831 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.m0Q5tc21e5 is 10KB 2024-09-16T03:54:28.845 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.m0Q5tc21e5 2024-09-16T03:54:28.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:28.909 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T03:54:28.909 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T03:54:28.909 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:28.957 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-09-16T03:54:28.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-09-16T03:54:28.978 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T03:54:28.978 DEBUG:teuthology.orchestra.run.smithi196:> sudo update-grub 2024-09-16T03:54:29.025 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-16T03:54:29.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T03:54:29.113 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-16T03:54:29.323 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-16T03:54:29.324 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T03:54:29.521 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T03:54:29.522 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T03:54:29.567 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T03:54:29.569 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-09-16T03:54:29.585 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-09-16T03:54:29.585 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-09-16T03:54:29.585 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-09-16T03:54:29.585 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-09-16T03:54:29.585 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-09-16T03:54:29.585 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.121.121 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-09-16T03:54:29.586 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-09-16T03:54:29.586 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-16T03:54:29.633 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.iyzZodIvSq 2024-09-16T03:54:29.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.iyzZodIvSq 2024-09-16T03:54:29.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.iyzZodIvSq 2024-09-16T03:54:29.805 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.iyzZodIvSq is 10KB 2024-09-16T03:54:29.863 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.iyzZodIvSq 2024-09-16T03:54:29.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:29.925 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T03:54:29.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T03:54:29.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T03:54:29.990 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T03:54:29.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2024-09-16T03:54:30.170 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-09-16T03:54:30.171 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:30.173 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-09-16T03:54:30.345 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:30.351 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:30.565 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:30.570 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:30.610 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:30.615 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:30.764 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:30.765 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:30.765 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:30.777 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-09-16T03:54:30.780 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-09-16T03:54:31.314 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-09-16T03:54:31.315 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T03:54:31.317 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-16T03:54:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T03:54:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T03:54:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T03:54:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T03:54:31.892 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T03:54:31.897 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T03:54:32.020 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T03:54:32.020 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T03:54:32.020 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T03:54:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-16T03:54:32.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-09-16T03:54:57.257 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T03:54:57.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T03:54:57.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:54:58.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T03:54:58.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T03:54:58.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:00.785 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-16T03:55:00.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T03:55:00.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:02.053 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-16T03:55:02.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-16T03:55:02.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:15.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-16T03:55:17.442 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-16T03:55:19.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-09-16T03:55:20.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-09-16T03:55:24.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T03:55:24.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:26.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T03:55:26.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:27.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-16T03:55:28.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T03:55:28.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:29.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-16T03:55:29.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:31.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-09-16T03:55:39.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T03:55:39.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:43.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T03:55:43.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:44.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-16T03:55:56.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T03:55:56.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:55:58.145 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-16T03:55:59.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-16T03:56:01.729 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-09-16T03:56:13.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T03:56:13.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:56:13.159 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-16T03:56:14.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T03:56:14.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:56:15.237 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-16T03:56:15.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T03:56:15.940 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-16T03:56:15.940 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-16T03:56:15.986 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-121-generic 2024-09-16T03:56:15.986 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T03:56:15.986 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:56:15.986 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T03:56:16.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T03:56:16.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:56:16.987 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T03:56:16.987 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:56:17.062 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-09-16T03:56:17.092 DEBUG:teuthology.parallel:result is None 2024-09-16T03:56:17.188 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-09-16T03:56:18.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T03:56:18.405 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.15.0-121-generic"... 2024-09-16T03:56:18.405 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-09-16T03:56:18.451 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-121-generic 2024-09-16T03:56:18.451 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T03:56:18.451 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:56:18.452 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T03:56:19.452 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-16T03:56:19.453 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:56:19.655 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-09-16T03:56:19.680 DEBUG:teuthology.parallel:result is None 2024-09-16T03:56:29.544 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T03:56:31.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T03:56:31.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:56:31.376 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-16T03:56:31.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T03:56:31.965 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-16T03:56:31.965 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-16T03:56:32.012 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-121-generic 2024-09-16T03:56:32.013 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T03:56:32.013 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:56:32.013 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T03:56:33.014 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T03:56:33.014 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:56:33.086 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-09-16T03:56:33.114 DEBUG:teuthology.parallel:result is None 2024-09-16T03:56:41.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-16T03:56:41.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:56:41.795 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-16T03:56:42.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-16T03:56:42.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-16T03:56:42.428 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-16T03:56:42.475 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-121-generic 2024-09-16T03:56:42.475 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T03:56:42.475 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:56:42.475 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T03:56:43.476 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-16T03:56:43.477 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:56:43.546 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-09-16T03:56:43.593 DEBUG:teuthology.parallel:result is None 2024-09-16T03:56:43.594 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T03:56:43.606 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T03:56:43.606 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:56:43.610 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:56:43.613 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:56:43.618 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:56:43.626 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T03:56:43.635 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T03:56:43.646 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T03:56:43.647 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:56:43.659 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:56:43.664 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:56:43.667 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:56:43.771 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T03:56:43.779 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T03:56:43.779 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:56:43.782 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:56:43.784 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:56:43.786 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:56:43.803 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.804 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.804 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.812 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.814 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.820 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.828 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:56:43.830 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T03:56:43.838 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T03:56:43.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:56:43.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:56:43.862 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:56:43.876 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:56:43.895 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T03:56:43.907 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T03:56:43.907 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:56:43.914 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:56:43.917 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:56:43.940 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:56:43.945 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:56:43.967 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:56:44.014 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T03:56:44.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:56:44.074 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:56:44.080 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:56:44.128 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T03:56:44.128 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:56:44.189 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:56:44.197 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:56:44.243 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T03:56:44.243 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:56:44.308 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:56:44.314 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:56:44.361 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T03:56:44.361 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:56:44.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-09-16T03:56:44.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-16T03:56:44.441 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-09-16T03:56:44.444 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-09-16T03:56:44.516 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T03:56:44.530 INFO:teuthology.task.internal:Starting timer... 2024-09-16T03:56:44.530 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T03:56:44.547 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T03:56:44.564 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-09-16T03:56:44.564 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-09-16T03:56:44.565 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2024-09-16T03:56:44.565 DEBUG:teuthology.task.selinux:Excluding smithi204: OS 'ubuntu' does not support SELinux 2024-09-16T03:56:44.565 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T03:56:44.565 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T03:56:44.566 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T03:56:44.566 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T03:56:44.576 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T03:56:44.581 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T03:56:44.708 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T03:56:44.720 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T03:56:44.721 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi050.front.sepia.ceph.com,smithi196.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T04:04:28.484 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-09-16T04:04:28.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T04:04:28.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T04:04:28.571 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-16T04:04:28.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-16T04:04:28.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-16T04:04:28.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T04:04:28.757 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-16T04:04:28.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-16T04:04:28.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T04:04:28.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T04:04:28.916 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-09-16T04:04:28.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-16T04:04:28.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T04:04:28.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T04:04:29.077 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-16T04:04:29.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-16T04:04:29.158 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T04:04:29.169 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T04:04:29.169 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T04:04:29.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:04:29.172 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T04:04:29.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:04:29.174 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T04:04:29.174 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:04:29.177 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T04:04:29.177 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:04:29.199 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T04:04:29.199 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Command line: ntpd -gq 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: ---------------------------------------------------- 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: corporation. Support and training for ntp-4 are 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: available at https://www.nwtime.org/support 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: ---------------------------------------------------- 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: proto: precision = 0.052 usec (-24) 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: basedate set to 2022-02-04 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: gps base set to 2022-02-06 (week 2196) 2024-09-16T04:04:29.200 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.201 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.201 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.201 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listen normally on 4 lo [::1]:123 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2024-09-16T04:04:29.202 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:29 ntpd[18370]: Listening on routing socket on fd #22 for interface updates 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Command line: ntpd -gq 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: ---------------------------------------------------- 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: corporation. Support and training for ntp-4 are 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: available at https://www.nwtime.org/support 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: ---------------------------------------------------- 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: proto: precision = 0.047 usec (-24) 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: basedate set to 2022-02-04 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: gps base set to 2022-02-06 (week 2196) 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.204 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.205 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.205 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listen normally on 4 lo [::1]:123 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2024-09-16T04:04:29.206 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:29 ntpd[18477]: Listening on routing socket on fd #22 for interface updates 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Command line: ntpd -gq 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: ---------------------------------------------------- 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: corporation. Support and training for ntp-4 are 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: available at https://www.nwtime.org/support 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: ---------------------------------------------------- 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: proto: precision = 0.047 usec (-24) 2024-09-16T04:04:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: basedate set to 2022-02-04 2024-09-16T04:04:29.209 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: gps base set to 2022-02-06 (week 2196) 2024-09-16T04:04:29.209 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.209 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listen normally on 4 lo [::1]:123 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%3]:123 2024-09-16T04:04:29.210 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:29 ntpd[18381]: Listening on routing socket on fd #22 for interface updates 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Command line: ntpd -gq 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: ---------------------------------------------------- 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: corporation. Support and training for ntp-4 are 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: available at https://www.nwtime.org/support 2024-09-16T04:04:29.230 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: ---------------------------------------------------- 2024-09-16T04:04:29.231 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: proto: precision = 0.059 usec (-24) 2024-09-16T04:04:29.231 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: basedate set to 2022-02-04 2024-09-16T04:04:29.231 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: gps base set to 2022-02-06 (week 2196) 2024-09-16T04:04:29.231 INFO:teuthology.orchestra.run.smithi204.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.232 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T04:04:29.232 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.232 INFO:teuthology.orchestra.run.smithi204.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listen normally on 3 enp3s0f1 172.21.15.204:123 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listen normally on 4 lo [::1]:123 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ab%5]:123 2024-09-16T04:04:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:29 ntpd[18484]: Listening on routing socket on fd #22 for interface updates 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:30.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:30.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:30 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:30 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:31.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:31 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:31.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:31 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:31.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:31 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:31.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:31 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:31.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:31 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:31.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:31 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:31.203 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:31 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:31.203 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:31 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:31.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:31 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:31.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:31 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:31.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:31 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:31.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:31 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:32 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:32.203 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:32 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:32 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:32 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:32 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:32 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:32.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:32 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:32.230 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:32 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.230 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:32 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:32 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:32.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:32 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:32.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:32 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:32.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:32 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.199 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:33 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:33 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:33 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:33 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:33 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:33 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:33 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:33 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:33.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:33 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:34.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:34.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:34 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:34.203 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:34.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:34 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:34 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:34 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:34 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:34.230 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:34 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:34 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:34 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:34.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:34 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:34.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:34 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:34.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:34 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:35 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:35 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:35 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:35 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:35 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:35 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:35 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.206 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:35 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:35.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:35 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:36.200 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:36.201 INFO:teuthology.orchestra.run.smithi032.stdout:16 Sep 04:04:36 ntpd[18370]: ntpd: time slew +0.000139 s 2024-09-16T04:04:36.201 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew +0.000139s 2024-09-16T04:04:36.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T04:04:36.201 INFO:teuthology.orchestra.run.smithi032.stderr:16 Sep 04:04:36 ntpd[18370]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T04:04:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:36 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:36 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:36 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:36 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:36 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:36.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:36 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:36 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:36 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:36 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:36 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:36 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:36.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:36 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:36.230 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:36 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:36 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:36 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:36.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:36 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:36.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:36 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:36.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:36 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:04:36.245 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-16T04:04:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:37.204 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:37.205 INFO:teuthology.orchestra.run.smithi196.stdout:16 Sep 04:04:37 ntpd[18477]: ntpd: time slew -0.000799 s 2024-09-16T04:04:37.205 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew -0.000799s 2024-09-16T04:04:37.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T04:04:37.205 INFO:teuthology.orchestra.run.smithi196.stderr:16 Sep 04:04:37 ntpd[18477]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:37 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:37.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:37.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:37 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:37.259 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:04:37.259 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-09-16T04:04:37.260 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:37.260 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:37.260 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:37.260 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:38 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:38 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:38 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:38 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:38.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:38 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:38.205 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:38 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:38.230 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:38.230 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:38.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:38.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:38.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:38.231 INFO:teuthology.orchestra.run.smithi204.stdout:16 Sep 04:04:38 ntpd[18484]: ntpd: time slew -0.000361 s 2024-09-16T04:04:38.231 INFO:teuthology.orchestra.run.smithi204.stdout:ntpd: time slew -0.000361s 2024-09-16T04:04:38.231 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:38.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T04:04:38.232 INFO:teuthology.orchestra.run.smithi204.stderr:16 Sep 04:04:38 ntpd[18484]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T04:04:38.279 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:04:38.280 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2024-09-16T04:04:38.280 INFO:teuthology.orchestra.run.smithi204.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:38.280 INFO:teuthology.orchestra.run.smithi204.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:38.280 INFO:teuthology.orchestra.run.smithi204.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:38.280 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:39.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:39.207 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stdout:16 Sep 04:04:39 ntpd[18381]: ntpd: time slew -0.000475 s 2024-09-16T04:04:39.208 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.000475s 2024-09-16T04:04:39.209 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T04:04:39.209 INFO:teuthology.orchestra.run.smithi050.stderr:16 Sep 04:04:39 ntpd[18381]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T04:04:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:04:39.259 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-16T04:04:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:04:39.259 INFO:teuthology.run_tasks:Running task install... 2024-09-16T04:04:39.269 DEBUG:teuthology.task.install:project ceph 2024-09-16T04:04:39.269 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T04:04:39.269 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T04:04:39.269 INFO:teuthology.task.install:Using flavor: default 2024-09-16T04:04:39.275 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T04:04:39.275 INFO:teuthology.task.install:extra packages: [] 2024-09-16T04:04:39.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-09-16T04:04:39.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-09-16T04:04:39.276 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2024-09-16T04:04:39.277 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-key list | grep Ceph 2024-09-16T04:04:39.344 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T04:04:39.344 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T04:04:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T04:04:39.362 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T04:04:39.372 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T04:04:39.372 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T04:04:39.373 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T04:04:39.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:04:39.379 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T04:04:39.379 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T04:04:39.379 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T04:04:39.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:04:39.392 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T04:04:39.392 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T04:04:39.392 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T04:04:39.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:04:39.426 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T04:04:39.427 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T04:04:39.427 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T04:04:39.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:04:39.525 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T04:04:39.525 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:39.531 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T04:04:39.531 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:39.535 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T04:04:39.535 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:39.574 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T04:04:39.575 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:39.644 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:04:39.644 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T04:04:39.647 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:04:39.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T04:04:39.652 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:04:39.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T04:04:39.660 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-09-16T04:04:39.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-16T04:04:39.686 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:04:39.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T04:04:39.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-16T04:04:39.700 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-09-16T04:04:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T04:04:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T04:04:39.855 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T04:04:39.868 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T04:04:39.868 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T04:04:39.869 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T04:04:39.873 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T04:04:39.877 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T04:04:39.882 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T04:04:39.888 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T04:04:39.896 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T04:04:39.903 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T04:04:39.912 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T04:04:39.921 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T04:04:39.923 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T04:04:39.927 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T04:04:39.935 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T04:04:39.942 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T04:04:39.945 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T04:04:39.956 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T04:04:39.957 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T04:04:39.957 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T04:04:39.965 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T04:04:39.966 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T04:04:39.967 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T04:04:39.983 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T04:04:39.986 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T04:04:39.986 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T04:04:39.987 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T04:04:39.993 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T04:04:40.014 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T04:04:40.015 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T04:04:40.048 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T04:04:40.070 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T04:04:40.130 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T04:04:40.151 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T04:04:40.207 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 29.0 kB in 0s (80.8 kB/s) 2024-09-16T04:04:40.225 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 29.0 kB in 0s (83.7 kB/s) 2024-09-16T04:04:40.300 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 29.0 kB in 0s (70.0 kB/s) 2024-09-16T04:04:40.323 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 29.0 kB in 0s (59.9 kB/s) 2024-09-16T04:04:41.235 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-16T04:04:41.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:41.260 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-16T04:04:41.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:41.316 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-16T04:04:41.338 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-16T04:04:41.339 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-16T04:04:41.342 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-16T04:04:41.356 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:41.359 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:04:41.420 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-16T04:04:41.421 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-16T04:04:41.531 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-16T04:04:41.532 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-16T04:04:41.553 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-16T04:04:41.554 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-16T04:04:41.608 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-16T04:04:41.609 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-16T04:04:41.635 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-16T04:04:41.636 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-16T04:04:41.749 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T04:04:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T04:04:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T04:04:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T04:04:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T04:04:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T04:04:41.751 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T04:04:41.751 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-16T04:04:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T04:04:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T04:04:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T04:04:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T04:04:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet zip 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-16T04:04:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-09-16T04:04:41.774 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T04:04:41.774 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T04:04:41.774 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T04:04:41.774 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T04:04:41.774 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T04:04:41.775 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T04:04:41.775 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T04:04:41.776 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-16T04:04:41.776 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T04:04:41.776 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T04:04:41.777 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T04:04:41.777 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T04:04:41.777 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T04:04:41.777 INFO:teuthology.orchestra.run.smithi032.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T04:04:41.778 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet zip 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T04:04:41.779 INFO:teuthology.orchestra.run.smithi032.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-16T04:04:41.780 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-09-16T04:04:41.798 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T04:04:41.798 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T04:04:41.798 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T04:04:41.798 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T04:04:41.799 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T04:04:41.799 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T04:04:41.799 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T04:04:41.800 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-09-16T04:04:41.800 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T04:04:41.800 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T04:04:41.800 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T04:04:41.800 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T04:04:41.801 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T04:04:41.801 INFO:teuthology.orchestra.run.smithi196.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T04:04:41.801 INFO:teuthology.orchestra.run.smithi196.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T04:04:41.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T04:04:41.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T04:04:41.802 INFO:teuthology.orchestra.run.smithi196.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet zip 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T04:04:41.803 INFO:teuthology.orchestra.run.smithi196.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T04:04:41.804 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T04:04:41.804 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T04:04:41.804 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-09-16T04:04:41.804 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2024-09-16T04:04:41.831 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T04:04:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T04:04:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T04:04:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T04:04:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T04:04:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T04:04:41.832 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T04:04:41.832 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-09-16T04:04:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T04:04:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T04:04:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T04:04:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T04:04:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T04:04:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet zip 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T04:04:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T04:04:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T04:04:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T04:04:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T04:04:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T04:04:41.838 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2024-09-16T04:04:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: btrfs-tools 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T04:04:41.865 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T04:04:41.866 INFO:teuthology.orchestra.run.smithi050.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T04:04:41.867 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T04:04:41.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T04:04:41.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T04:04:41.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T04:04:41.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T04:04:41.868 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T04:04:41.868 INFO:teuthology.orchestra.run.smithi050.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T04:04:41.889 INFO:teuthology.orchestra.run.smithi032.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T04:04:41.890 INFO:teuthology.orchestra.run.smithi032.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T04:04:41.891 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T04:04:41.892 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T04:04:41.892 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T04:04:41.892 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T04:04:41.892 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T04:04:41.892 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T04:04:41.892 INFO:teuthology.orchestra.run.smithi032.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T04:04:41.907 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-09-16T04:04:41.907 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T04:04:41.907 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T04:04:41.907 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.909 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T04:04:41.910 INFO:teuthology.orchestra.run.smithi196.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T04:04:41.938 INFO:teuthology.orchestra.run.smithi204.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T04:04:41.939 INFO:teuthology.orchestra.run.smithi204.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T04:04:41.940 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T04:04:41.941 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T04:04:41.941 INFO:teuthology.orchestra.run.smithi204.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T04:04:41.941 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T04:04:41.941 INFO:teuthology.orchestra.run.smithi204.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T04:04:41.941 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T04:04:41.941 INFO:teuthology.orchestra.run.smithi204.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T04:04:41.952 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T04:04:41.952 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 181 MB of archives. 2024-09-16T04:04:41.953 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T04:04:41.953 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T04:04:42.012 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T04:04:42.012 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 181 MB of archives. 2024-09-16T04:04:42.012 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T04:04:42.013 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T04:04:42.036 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T04:04:42.042 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T04:04:42.045 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T04:04:42.053 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T04:04:42.053 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 181 MB of archives. 2024-09-16T04:04:42.053 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T04:04:42.053 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T04:04:42.056 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T04:04:42.062 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T04:04:42.083 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T04:04:42.083 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 181 MB of archives. 2024-09-16T04:04:42.083 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T04:04:42.083 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T04:04:42.099 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T04:04:42.122 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T04:04:42.127 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T04:04:42.128 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T04:04:42.139 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T04:04:42.144 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T04:04:42.144 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T04:04:42.145 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T04:04:42.154 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T04:04:42.157 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T04:04:42.159 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T04:04:42.161 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T04:04:42.162 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T04:04:42.163 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T04:04:42.179 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T04:04:42.181 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T04:04:42.181 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T04:04:42.182 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T04:04:42.183 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T04:04:42.183 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T04:04:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T04:04:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T04:04:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T04:04:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T04:04:42.213 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T04:04:42.217 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T04:04:42.218 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T04:04:42.219 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T04:04:42.220 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T04:04:42.221 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T04:04:42.230 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T04:04:42.231 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T04:04:42.233 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T04:04:42.235 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T04:04:42.247 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T04:04:42.257 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T04:04:42.257 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T04:04:42.258 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T04:04:42.259 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T04:04:42.261 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T04:04:42.265 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T04:04:42.265 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T04:04:42.266 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T04:04:42.269 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T04:04:42.270 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T04:04:42.282 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T04:04:42.283 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T04:04:42.284 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T04:04:42.289 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T04:04:42.321 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T04:04:42.342 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T04:04:42.358 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T04:04:42.359 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T04:04:42.360 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T04:04:42.360 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T04:04:42.361 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T04:04:42.371 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T04:04:42.379 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T04:04:42.381 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T04:04:42.381 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T04:04:42.397 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T04:04:42.397 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T04:04:42.397 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T04:04:42.398 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T04:04:42.398 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T04:04:42.399 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T04:04:42.403 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T04:04:42.412 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T04:04:42.412 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T04:04:42.415 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T04:04:42.427 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T04:04:42.428 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T04:04:42.429 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T04:04:42.430 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T04:04:42.431 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T04:04:42.432 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T04:04:42.434 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T04:04:42.434 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T04:04:42.436 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T04:04:42.437 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T04:04:42.437 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T04:04:42.442 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T04:04:42.446 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T04:04:42.447 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T04:04:42.450 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T04:04:42.464 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T04:04:42.465 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T04:04:42.465 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T04:04:42.467 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T04:04:42.467 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T04:04:42.476 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T04:04:42.480 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T04:04:42.480 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T04:04:42.484 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T04:04:42.486 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T04:04:42.486 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T04:04:42.488 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T04:04:42.489 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T04:04:42.511 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T04:04:42.516 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T04:04:42.525 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T04:04:42.528 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T04:04:42.544 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T04:04:42.551 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T04:04:42.552 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T04:04:42.554 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T04:04:42.556 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T04:04:42.558 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T04:04:42.567 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T04:04:42.570 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T04:04:42.576 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T04:04:42.578 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T04:04:42.582 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T04:04:42.583 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T04:04:42.590 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T04:04:42.608 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T04:04:42.610 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T04:04:42.649 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T04:04:42.785 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T04:04:42.788 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T04:04:42.798 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T04:04:42.800 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T04:04:42.812 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T04:04:42.841 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T04:04:42.841 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T04:04:42.850 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T04:04:42.851 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T04:04:42.851 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T04:04:42.852 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T04:04:42.870 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T04:04:42.874 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T04:04:42.879 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T04:04:42.880 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T04:04:42.881 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T04:04:42.882 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T04:04:42.890 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T04:04:42.890 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T04:04:42.891 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T04:04:42.892 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T04:04:42.910 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T04:04:42.914 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T04:04:42.919 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T04:04:42.919 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T04:04:42.923 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T04:04:42.928 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T04:04:42.929 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T04:04:42.930 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T04:04:42.944 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T04:04:42.948 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T04:04:42.953 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T04:04:42.957 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T04:04:42.963 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T04:04:42.963 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T04:04:42.968 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T04:04:42.972 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T04:04:42.976 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T04:04:42.977 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T04:04:42.978 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T04:04:42.980 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T04:04:42.981 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T04:04:42.981 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T04:04:42.987 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T04:04:42.989 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T04:04:42.999 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T04:04:43.001 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T04:04:43.003 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T04:04:43.007 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T04:04:43.012 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T04:04:43.015 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T04:04:43.016 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T04:04:43.017 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T04:04:43.017 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T04:04:43.019 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T04:04:43.019 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T04:04:43.020 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T04:04:43.026 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T04:04:43.045 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T04:04:43.045 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T04:04:43.047 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T04:04:43.051 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T04:04:43.055 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T04:04:43.056 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T04:04:43.057 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T04:04:43.059 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T04:04:43.059 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T04:04:43.060 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T04:04:43.063 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T04:04:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T04:04:43.065 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T04:04:43.070 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T04:04:43.071 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T04:04:43.087 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T04:04:43.103 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T04:04:43.103 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T04:04:43.104 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T04:04:43.109 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T04:04:43.110 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T04:04:43.126 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T04:04:43.127 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T04:04:43.127 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T04:04:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T04:04:43.129 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T04:04:43.143 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T04:04:43.143 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T04:04:43.144 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T04:04:43.149 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T04:04:43.150 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T04:04:43.168 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T04:04:43.169 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T04:04:43.171 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T04:04:43.171 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T04:04:43.206 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T04:04:43.209 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T04:04:43.210 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T04:04:43.210 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T04:04:43.210 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T04:04:43.211 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T04:04:43.211 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T04:04:43.212 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T04:04:43.222 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T04:04:43.249 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T04:04:43.252 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T04:04:43.253 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T04:04:43.254 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T04:04:43.265 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T04:04:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T04:04:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T04:04:43.289 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T04:04:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T04:04:43.292 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T04:04:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T04:04:43.293 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T04:04:43.294 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T04:04:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T04:04:43.305 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T04:04:43.332 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T04:04:43.332 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T04:04:43.333 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T04:04:43.335 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T04:04:43.339 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T04:04:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T04:04:43.370 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T04:04:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T04:04:43.372 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T04:04:43.372 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T04:04:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T04:04:43.375 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T04:04:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T04:04:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T04:04:43.379 INFO:teuthology.orchestra.run.smithi204.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T04:04:43.395 INFO:teuthology.orchestra.run.smithi204.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T04:04:43.414 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T04:04:43.417 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T04:04:43.418 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T04:04:43.423 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T04:04:43.424 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T04:04:43.450 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T04:04:43.452 INFO:teuthology.orchestra.run.smithi204.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T04:04:43.455 INFO:teuthology.orchestra.run.smithi204.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T04:04:43.455 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T04:04:43.456 INFO:teuthology.orchestra.run.smithi204.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T04:04:43.461 INFO:teuthology.orchestra.run.smithi204.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T04:04:43.463 INFO:teuthology.orchestra.run.smithi204.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T04:04:43.466 INFO:teuthology.orchestra.run.smithi204.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T04:04:43.496 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T04:04:43.500 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T04:04:43.529 INFO:teuthology.orchestra.run.smithi204.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T04:04:43.530 INFO:teuthology.orchestra.run.smithi204.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T04:04:43.534 INFO:teuthology.orchestra.run.smithi204.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T04:04:43.534 INFO:teuthology.orchestra.run.smithi204.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T04:04:43.536 INFO:teuthology.orchestra.run.smithi204.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T04:04:43.539 INFO:teuthology.orchestra.run.smithi204.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T04:04:43.599 INFO:teuthology.orchestra.run.smithi204.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T04:04:43.617 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T04:04:43.619 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T04:04:43.621 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T04:04:43.622 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T04:04:43.624 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T04:04:43.662 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T04:04:43.663 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T04:04:43.664 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T04:04:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T04:04:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T04:04:43.666 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T04:04:43.667 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T04:04:43.669 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T04:04:43.701 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T04:04:43.704 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T04:04:43.705 INFO:teuthology.orchestra.run.smithi204.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T04:04:43.705 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T04:04:43.707 INFO:teuthology.orchestra.run.smithi204.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T04:04:43.709 INFO:teuthology.orchestra.run.smithi204.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T04:04:43.710 INFO:teuthology.orchestra.run.smithi204.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T04:04:43.713 INFO:teuthology.orchestra.run.smithi204.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T04:04:43.721 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T04:04:43.721 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T04:04:43.750 INFO:teuthology.orchestra.run.smithi204.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T04:04:43.753 INFO:teuthology.orchestra.run.smithi204.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T04:04:43.753 INFO:teuthology.orchestra.run.smithi204.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T04:04:43.765 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T04:04:43.765 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T04:04:43.784 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T04:04:43.785 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T04:04:43.786 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T04:04:43.787 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T04:04:43.788 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T04:04:43.789 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T04:04:43.796 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T04:04:43.813 INFO:teuthology.orchestra.run.smithi204.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T04:04:43.813 INFO:teuthology.orchestra.run.smithi204.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T04:04:43.829 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T04:04:43.830 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T04:04:43.831 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T04:04:43.832 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T04:04:43.832 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T04:04:43.833 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T04:04:43.839 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T04:04:43.865 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T04:04:43.869 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T04:04:43.870 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T04:04:43.872 INFO:teuthology.orchestra.run.smithi204.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T04:04:43.873 INFO:teuthology.orchestra.run.smithi204.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T04:04:43.874 INFO:teuthology.orchestra.run.smithi204.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T04:04:43.876 INFO:teuthology.orchestra.run.smithi204.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T04:04:43.876 INFO:teuthology.orchestra.run.smithi204.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T04:04:43.878 INFO:teuthology.orchestra.run.smithi204.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T04:04:43.884 INFO:teuthology.orchestra.run.smithi204.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T04:04:43.910 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T04:04:43.914 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T04:04:43.915 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T04:04:43.946 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T04:04:43.953 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T04:04:43.954 INFO:teuthology.orchestra.run.smithi204.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T04:04:43.955 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T04:04:43.956 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T04:04:43.958 INFO:teuthology.orchestra.run.smithi204.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T04:04:43.959 INFO:teuthology.orchestra.run.smithi204.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T04:04:43.967 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T04:04:43.969 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T04:04:43.977 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T04:04:43.992 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T04:04:43.998 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T04:04:44.000 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T04:04:44.002 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T04:04:44.013 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T04:04:44.014 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T04:04:44.022 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T04:04:44.027 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T04:04:44.029 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T04:04:44.030 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T04:04:44.035 INFO:teuthology.orchestra.run.smithi204.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T04:04:44.043 INFO:teuthology.orchestra.run.smithi204.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T04:04:44.045 INFO:teuthology.orchestra.run.smithi204.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T04:04:44.047 INFO:teuthology.orchestra.run.smithi204.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T04:04:44.058 INFO:teuthology.orchestra.run.smithi204.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T04:04:44.059 INFO:teuthology.orchestra.run.smithi204.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T04:04:44.067 INFO:teuthology.orchestra.run.smithi204.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T04:04:44.073 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T04:04:44.075 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T04:04:44.076 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T04:04:44.109 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T04:04:44.117 INFO:teuthology.orchestra.run.smithi204.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T04:04:44.119 INFO:teuthology.orchestra.run.smithi204.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T04:04:44.120 INFO:teuthology.orchestra.run.smithi204.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T04:04:44.154 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T04:04:44.155 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T04:04:44.156 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T04:04:44.157 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T04:04:44.170 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T04:04:44.171 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T04:04:44.172 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T04:04:44.174 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T04:04:44.175 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T04:04:44.175 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T04:04:44.177 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T04:04:44.181 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T04:04:44.182 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T04:04:44.199 INFO:teuthology.orchestra.run.smithi204.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T04:04:44.201 INFO:teuthology.orchestra.run.smithi204.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T04:04:44.220 INFO:teuthology.orchestra.run.smithi204.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T04:04:44.221 INFO:teuthology.orchestra.run.smithi204.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T04:04:44.222 INFO:teuthology.orchestra.run.smithi204.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T04:04:44.227 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T04:04:44.228 INFO:teuthology.orchestra.run.smithi204.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T04:04:44.229 INFO:teuthology.orchestra.run.smithi204.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T04:04:44.256 INFO:teuthology.orchestra.run.smithi204.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T04:04:44.287 INFO:teuthology.orchestra.run.smithi204.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T04:04:44.296 INFO:teuthology.orchestra.run.smithi204.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T04:04:44.355 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T04:04:44.389 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T04:04:44.392 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T04:04:44.470 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T04:04:44.674 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T04:04:44.735 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T04:04:44.865 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T04:04:44.999 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T04:04:45.013 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T04:04:45.045 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T04:04:45.137 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T04:04:45.196 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T04:04:45.212 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T04:04:45.215 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T04:04:45.349 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T04:04:45.618 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T04:04:45.812 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T04:04:45.812 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T04:04:45.828 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T04:04:45.830 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T04:04:45.888 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T04:04:45.903 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T04:04:45.931 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T04:04:46.032 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T04:04:46.408 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T04:04:46.408 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T04:04:46.491 INFO:teuthology.orchestra.run.smithi204.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T04:04:46.844 INFO:teuthology.orchestra.run.smithi204.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T04:04:46.849 INFO:teuthology.orchestra.run.smithi204.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T04:04:46.852 INFO:teuthology.orchestra.run.smithi204.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T04:04:46.995 INFO:teuthology.orchestra.run.smithi204.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T04:04:47.431 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T04:04:47.431 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T04:04:47.449 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T04:04:47.551 INFO:teuthology.orchestra.run.smithi204.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T04:04:47.632 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T04:04:47.647 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T04:04:47.650 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T04:04:47.712 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T04:04:47.712 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T04:04:47.734 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T04:04:47.822 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T04:04:47.952 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T04:04:48.014 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T04:04:48.035 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T04:04:48.218 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T04:04:48.556 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T04:04:48.556 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T04:04:48.954 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T04:04:48.955 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T04:04:49.057 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T04:04:49.061 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T04:04:49.063 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T04:04:49.436 INFO:teuthology.orchestra.run.smithi204.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T04:04:49.437 INFO:teuthology.orchestra.run.smithi204.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T04:04:49.454 INFO:teuthology.orchestra.run.smithi204.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T04:04:49.582 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T04:04:49.630 INFO:teuthology.orchestra.run.smithi204.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T04:04:49.675 INFO:teuthology.orchestra.run.smithi204.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T04:04:49.678 INFO:teuthology.orchestra.run.smithi204.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T04:04:49.813 INFO:teuthology.orchestra.run.smithi204.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T04:04:50.192 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 181 MB in 8s (23.5 MB/s) 2024-09-16T04:04:50.313 INFO:teuthology.orchestra.run.smithi204.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T04:04:50.313 INFO:teuthology.orchestra.run.smithi204.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T04:04:50.442 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T04:04:50.547 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T04:04:50.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T04:04:50.641 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:04:51.119 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T04:04:51.146 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T04:04:51.194 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:04:51.497 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T04:04:51.524 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T04:04:51.555 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:04:51.929 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T04:04:51.931 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T04:04:51.932 INFO:teuthology.orchestra.run.smithi196.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T04:04:52.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T04:04:52.035 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:52.083 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:52.330 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T04:04:52.332 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T04:04:52.334 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T04:04:52.454 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T04:04:52.480 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:52.512 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:52.559 INFO:teuthology.orchestra.run.smithi196.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T04:04:52.843 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T04:04:52.856 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T04:04:52.883 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:52.923 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:53.129 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 181 MB in 11s (17.0 MB/s) 2024-09-16T04:04:53.274 INFO:teuthology.orchestra.run.smithi204.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T04:04:53.277 INFO:teuthology.orchestra.run.smithi204.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T04:04:53.278 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T04:04:53.278 INFO:teuthology.orchestra.run.smithi204.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T04:04:53.293 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T04:04:53.319 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T04:04:53.359 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:04:53.374 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T04:04:53.379 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T04:04:53.431 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 181 MB in 11s (16.5 MB/s) 2024-09-16T04:04:53.460 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:04:53.545 INFO:teuthology.orchestra.run.smithi204.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T04:04:53.602 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T04:04:53.645 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librados2. 2024-09-16T04:04:53.661 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:53.695 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:53.705 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T04:04:53.710 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T04:04:53.792 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:04:53.804 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T04:04:53.831 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T04:04:53.871 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:04:54.118 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 181 MB in 12s (15.6 MB/s) 2024-09-16T04:04:54.132 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librbd1. 2024-09-16T04:04:54.136 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T04:04:54.158 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:54.163 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T04:04:54.182 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T04:04:54.198 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:54.209 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T04:04:54.220 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:04:54.249 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:04:54.282 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T04:04:54.380 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T04:04:54.385 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T04:04:54.489 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:04:54.623 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T04:04:54.650 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T04:04:54.651 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T04:04:54.677 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:54.706 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:04:54.711 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T04:04:54.717 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:54.737 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:54.786 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:54.826 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T04:04:54.853 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T04:04:54.892 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:04:54.987 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-09-16T04:04:55.002 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:55.045 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:55.126 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T04:04:55.153 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:55.188 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T04:04:55.197 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T04:04:55.201 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:55.214 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T04:04:55.224 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:55.254 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:04:55.263 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:55.373 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T04:04:55.399 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:55.439 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:55.591 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T04:04:55.612 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T04:04:55.620 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:55.639 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:55.650 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:55.679 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:55.683 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T04:04:55.709 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:55.758 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:55.909 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T04:04:55.925 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:55.967 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:55.997 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T04:04:56.015 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T04:04:56.017 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T04:04:56.042 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:56.055 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:04:56.081 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:56.128 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T04:04:56.154 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:56.194 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:56.261 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T04:04:56.277 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:56.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:56.374 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librados2. 2024-09-16T04:04:56.393 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T04:04:56.400 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:56.405 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T04:04:56.436 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:04:56.441 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:56.547 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T04:04:56.574 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T04:04:56.614 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:04:56.731 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T04:04:56.758 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T04:04:56.789 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:04:56.885 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librbd1. 2024-09-16T04:04:56.912 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:56.921 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librados2. 2024-09-16T04:04:56.947 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:56.952 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:56.959 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T04:04:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T04:04:57.025 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:04:57.101 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T04:04:57.127 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T04:04:57.167 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T04:04:57.204 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:57.345 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librados2. 2024-09-16T04:04:57.371 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:57.396 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T04:04:57.411 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:57.422 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:57.428 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T04:04:57.444 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:57.463 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:57.487 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:57.682 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librbd1. 2024-09-16T04:04:57.709 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:57.748 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:57.765 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2024-09-16T04:04:57.792 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:57.832 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:57.839 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T04:04:57.856 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librbd1. 2024-09-16T04:04:57.867 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T04:04:57.883 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:57.906 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:04:57.923 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.101 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T04:04:58.128 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:58.142 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T04:04:58.150 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T04:04:58.158 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:58.159 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.166 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T04:04:58.192 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.200 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:04:58.359 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T04:04:58.385 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:58.403 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T04:04:58.425 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.428 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-09-16T04:04:58.430 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:58.455 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:58.470 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.494 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T04:04:58.495 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.510 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T04:04:58.553 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:04:58.703 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rados. 2024-09-16T04:04:58.718 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:58.761 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.806 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T04:04:58.814 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T04:04:58.833 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:58.841 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:58.873 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.880 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:58.898 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua5.1. 2024-09-16T04:04:58.925 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T04:04:58.964 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:04:59.116 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T04:04:59.132 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:59.173 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T04:04:59.174 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:59.199 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:59.200 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T04:04:59.227 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T04:04:59.267 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:04:59.275 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-any. 2024-09-16T04:04:59.289 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:59.291 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T04:04:59.326 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T04:04:59.469 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T04:04:59.496 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:59.508 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T04:04:59.535 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:59.545 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T04:04:59.552 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:59.570 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package zip. 2024-09-16T04:04:59.572 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T04:04:59.575 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:59.585 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T04:04:59.604 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T04:04:59.637 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T04:04:59.830 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T04:04:59.839 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T04:04:59.857 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T04:04:59.866 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:04:59.886 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T04:04:59.888 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:04:59.905 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:59.915 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:04:59.952 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:04:59.956 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package unzip. 2024-09-16T04:04:59.983 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T04:05:00.023 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:00.174 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T04:05:00.201 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T04:05:00.240 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T04:05:00.267 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T04:05:00.281 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T04:05:00.294 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T04:05:00.307 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T04:05:00.333 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:05:00.347 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:05:00.402 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package luarocks. 2024-09-16T04:05:00.428 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T04:05:00.468 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:05:00.494 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T04:05:00.520 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:00.560 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:00.619 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T04:05:00.646 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T04:05:00.658 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T04:05:00.685 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T04:05:00.686 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:00.725 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T04:05:00.884 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-09-16T04:05:00.905 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T04:05:00.912 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:00.931 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T04:05:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:00.971 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:05:00.977 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T04:05:00.988 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T04:05:00.993 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:01.004 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T04:05:01.036 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:01.038 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:05:01.215 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T04:05:01.231 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T04:05:01.265 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:01.350 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua5.1. 2024-09-16T04:05:01.377 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T04:05:01.381 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T04:05:01.397 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T04:05:01.416 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:01.431 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:05:01.552 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T04:05:01.554 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T04:05:01.567 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T04:05:01.581 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:01.609 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:05:01.629 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:01.709 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T04:05:01.728 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-any. 2024-09-16T04:05:01.735 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T04:05:01.743 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T04:05:01.775 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:01.828 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T04:05:01.931 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T04:05:01.937 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua5.1. 2024-09-16T04:05:01.958 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T04:05:01.964 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T04:05:01.990 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:02.004 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:02.061 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T04:05:02.072 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package zip. 2024-09-16T04:05:02.076 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T04:05:02.087 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T04:05:02.119 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:05:02.130 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T04:05:02.309 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T04:05:02.336 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:02.376 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:02.440 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua5.1. 2024-09-16T04:05:02.442 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package unzip. 2024-09-16T04:05:02.455 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T04:05:02.457 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T04:05:02.482 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-any. 2024-09-16T04:05:02.498 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:02.498 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T04:05:02.500 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:02.540 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T04:05:02.746 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-09-16T04:05:02.768 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package zip. 2024-09-16T04:05:02.773 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:02.784 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T04:05:02.801 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-any. 2024-09-16T04:05:02.812 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:02.817 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T04:05:02.827 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T04:05:02.854 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package luarocks. 2024-09-16T04:05:02.867 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T04:05:02.881 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T04:05:02.920 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:05:03.087 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package unzip. 2024-09-16T04:05:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T04:05:03.111 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package zip. 2024-09-16T04:05:03.127 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T04:05:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:03.170 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T04:05:03.320 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2024-09-16T04:05:03.346 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:03.386 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:03.482 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package unzip. 2024-09-16T04:05:03.508 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T04:05:03.548 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:03.557 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package luarocks. 2024-09-16T04:05:03.584 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T04:05:03.624 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:05:03.910 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package luarocks. 2024-09-16T04:05:03.933 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T04:05:03.947 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T04:05:03.969 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:05:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:04.006 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-09-16T04:05:04.013 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:04.034 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:04.073 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:04.151 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-09-16T04:05:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:04.220 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:04.316 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T04:05:04.331 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T04:05:04.343 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librgw2. 2024-09-16T04:05:04.366 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:04.369 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:04.410 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:04.644 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T04:05:04.650 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T04:05:04.671 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:04.677 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:04.708 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:04.822 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T04:05:04.849 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T04:05:04.889 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:04.946 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T04:05:04.961 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:05.004 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:05.036 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T04:05:05.063 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T04:05:05.103 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:05.130 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2024-09-16T04:05:05.157 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:05.197 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:05.217 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T04:05:05.243 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T04:05:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:05:05.324 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T04:05:05.350 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T04:05:05.390 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:05.405 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T04:05:05.432 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:05.472 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:05.611 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T04:05:05.638 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T04:05:05.668 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T04:05:05.677 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:05.695 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:05.734 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:05.900 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-09-16T04:05:05.927 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:05.956 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T04:05:05.966 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:05.973 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T04:05:06.014 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:05:06.155 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-common. 2024-09-16T04:05:06.182 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:06.221 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:06.541 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T04:05:06.557 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T04:05:06.610 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2024-09-16T04:05:06.636 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:06.650 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:05:06.686 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:06.919 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T04:05:06.946 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T04:05:06.986 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T04:05:07.289 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-portend. 2024-09-16T04:05:07.316 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T04:05:07.347 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-09-16T04:05:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T04:05:07.374 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:07.422 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:07.552 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-base. 2024-09-16T04:05:07.579 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:07.606 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T04:05:07.619 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:07.632 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T04:05:07.658 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T04:05:07.664 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:07.685 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T04:05:07.725 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T04:05:07.950 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T04:05:07.976 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T04:05:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T04:05:08.016 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:05:08.038 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T04:05:08.069 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:05:08.093 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T04:05:08.119 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T04:05:08.159 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:08.189 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T04:05:08.205 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T04:05:08.239 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:08.345 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T04:05:08.371 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T04:05:08.412 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:08.415 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T04:05:08.437 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T04:05:08.441 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T04:05:08.463 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T04:05:08.481 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T04:05:08.495 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:05:08.542 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T04:05:08.569 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T04:05:08.608 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:05:08.714 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T04:05:08.740 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T04:05:08.751 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T04:05:08.778 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T04:05:08.780 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:05:08.781 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T04:05:08.797 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T04:05:08.809 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T04:05:08.831 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:08.903 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T04:05:08.930 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T04:05:08.970 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:09.067 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T04:05:09.082 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T04:05:09.095 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T04:05:09.116 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:05:09.122 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T04:05:09.125 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T04:05:09.152 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T04:05:09.162 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:09.200 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:05:09.256 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T04:05:09.283 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T04:05:09.322 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:05:09.386 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T04:05:09.412 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T04:05:09.453 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T04:05:09.465 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-09-16T04:05:09.492 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T04:05:09.528 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T04:05:09.531 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:05:09.555 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T04:05:09.595 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:05:09.600 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T04:05:09.627 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T04:05:09.667 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:05:09.755 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-portend. 2024-09-16T04:05:09.781 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T04:05:09.822 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T04:05:09.859 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T04:05:09.872 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T04:05:09.886 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T04:05:09.899 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T04:05:09.926 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:05:09.939 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T04:05:10.045 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T04:05:10.071 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T04:05:10.103 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T04:05:10.124 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T04:05:10.151 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T04:05:10.175 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-portend. 2024-09-16T04:05:10.199 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T04:05:10.201 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T04:05:10.229 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T04:05:10.241 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T04:05:10.256 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T04:05:10.287 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:05:10.423 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-portend. 2024-09-16T04:05:10.450 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T04:05:10.485 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T04:05:10.489 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T04:05:10.512 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T04:05:10.543 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:05:10.553 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T04:05:10.579 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T04:05:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-09-16T04:05:10.617 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T04:05:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T04:05:10.682 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:05:10.792 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T04:05:10.819 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T04:05:10.859 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T04:05:10.889 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T04:05:10.916 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T04:05:10.922 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T04:05:10.949 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T04:05:10.955 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T04:05:10.988 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:05:11.018 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T04:05:11.045 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T04:05:11.087 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:11.145 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T04:05:11.172 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T04:05:11.203 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:05:11.267 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T04:05:11.293 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T04:05:11.333 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T04:05:11.342 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T04:05:11.369 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T04:05:11.387 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T04:05:11.408 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T04:05:11.414 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T04:05:11.454 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:11.551 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T04:05:11.577 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T04:05:11.609 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T04:05:11.619 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T04:05:11.646 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T04:05:11.686 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:11.690 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-09-16T04:05:11.706 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T04:05:11.720 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T04:05:11.747 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T04:05:11.748 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:11.786 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T04:05:11.904 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T04:05:11.930 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T04:05:11.970 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T04:05:12.014 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2024-09-16T04:05:12.040 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T04:05:12.068 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T04:05:12.080 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:05:12.081 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T04:05:12.084 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T04:05:12.107 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T04:05:12.126 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:12.147 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:12.273 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T04:05:12.300 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T04:05:12.340 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:12.375 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-09-16T04:05:12.391 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T04:05:12.400 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T04:05:12.424 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:05:12.426 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T04:05:12.429 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T04:05:12.456 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T04:05:12.466 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:05:12.495 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:05:12.643 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-mako. 2024-09-16T04:05:12.669 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T04:05:12.709 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:05:12.736 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T04:05:12.763 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T04:05:12.765 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T04:05:12.793 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T04:05:12.803 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:05:12.824 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T04:05:12.835 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T04:05:12.862 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T04:05:12.902 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:05:13.013 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T04:05:13.039 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T04:05:13.069 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T04:05:13.079 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:05:13.095 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T04:05:13.122 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T04:05:13.134 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:05:13.149 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T04:05:13.155 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2024-09-16T04:05:13.181 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T04:05:13.189 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:05:13.213 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:05:13.357 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T04:05:13.384 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T04:05:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:05:13.483 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-09-16T04:05:13.510 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T04:05:13.548 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T04:05:13.549 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:05:13.575 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T04:05:13.614 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webob. 2024-09-16T04:05:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T04:05:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:05:13.878 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T04:05:13.904 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T04:05:13.947 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:13.950 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-idna. 2024-09-16T04:05:13.978 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T04:05:14.017 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:05:14.113 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T04:05:14.139 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T04:05:14.238 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T04:05:14.255 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T04:05:14.288 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:14.299 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T04:05:14.303 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T04:05:14.319 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T04:05:14.326 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T04:05:14.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:05:14.369 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:14.391 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:14.574 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-09-16T04:05:14.602 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T04:05:14.641 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:14.667 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests. 2024-09-16T04:05:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T04:05:14.694 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T04:05:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T04:05:14.733 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:05:14.735 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:14.936 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T04:05:14.952 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T04:05:14.986 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:15.055 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2024-09-16T04:05:15.082 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T04:05:15.121 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:15.263 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T04:05:15.290 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T04:05:15.330 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:05:15.391 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T04:05:15.407 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T04:05:15.441 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:15.442 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T04:05:15.468 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T04:05:15.508 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:15.520 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T04:05:15.547 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T04:05:15.633 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T04:05:15.660 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T04:05:15.699 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T04:05:15.736 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-paste. 2024-09-16T04:05:15.751 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T04:05:15.786 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:15.810 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T04:05:15.838 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T04:05:15.877 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:05:15.945 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:05:16.019 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T04:05:16.046 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T04:05:16.085 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:05:16.097 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T04:05:16.113 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T04:05:16.156 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:16.180 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T04:05:16.206 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T04:05:16.255 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T04:05:16.264 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T04:05:16.281 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:16.331 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:16.448 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T04:05:16.467 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T04:05:16.476 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T04:05:16.494 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T04:05:16.514 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:16.534 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:05:16.549 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T04:05:16.576 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T04:05:16.607 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:05:16.812 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T04:05:16.834 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-idna. 2024-09-16T04:05:16.838 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T04:05:16.850 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T04:05:16.870 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T04:05:16.878 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T04:05:16.892 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:05:16.897 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:16.912 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T04:05:16.928 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T04:05:16.936 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:16.962 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:17.170 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T04:05:17.190 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T04:05:17.197 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T04:05:17.216 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T04:05:17.222 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T04:05:17.228 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:05:17.249 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T04:05:17.256 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:05:17.289 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:17.290 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-idna. 2024-09-16T04:05:17.316 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T04:05:17.356 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:05:17.523 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests. 2024-09-16T04:05:17.547 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T04:05:17.581 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:05:17.592 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T04:05:17.603 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T04:05:17.619 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T04:05:17.630 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T04:05:17.658 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T04:05:17.667 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T04:05:17.669 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:17.695 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T04:05:17.734 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:05:17.834 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T04:05:17.851 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T04:05:17.884 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:05:17.986 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T04:05:17.997 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-idna. 2024-09-16T04:05:18.013 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:18.024 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T04:05:18.053 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:18.062 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests. 2024-09-16T04:05:18.064 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:05:18.088 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T04:05:18.128 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:05:18.153 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T04:05:18.169 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:18.204 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:18.342 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T04:05:18.358 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T04:05:18.400 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:05:18.414 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T04:05:18.440 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T04:05:18.441 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:18.466 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T04:05:18.472 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:18.506 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:05:18.575 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T04:05:18.602 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:18.641 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:18.695 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests. 2024-09-16T04:05:18.722 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T04:05:18.762 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:05:18.792 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T04:05:18.808 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:18.850 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:18.919 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T04:05:18.935 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T04:05:18.969 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:19.065 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T04:05:19.068 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T04:05:19.091 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T04:05:19.095 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:19.131 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:05:19.151 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:19.197 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T04:05:19.224 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:19.263 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:19.289 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T04:05:19.316 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T04:05:19.355 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T04:05:19.402 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T04:05:19.428 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:19.468 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:19.575 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T04:05:19.601 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T04:05:19.641 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:19.658 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T04:05:19.685 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:19.716 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:19.840 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T04:05:19.866 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:19.906 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:19.944 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T04:05:19.970 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T04:05:20.010 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T04:05:20.078 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T04:05:20.105 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:20.144 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:20.218 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T04:05:20.237 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-09-16T04:05:20.244 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T04:05:20.253 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:20.284 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:20.295 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:20.297 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T04:05:20.323 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:20.355 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:20.598 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T04:05:20.625 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:20.656 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:20.708 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T04:05:20.735 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:20.737 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T04:05:20.764 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T04:05:20.774 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:20.804 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T04:05:20.856 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T04:05:20.883 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:20.922 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:21.018 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T04:05:21.045 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:21.084 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:21.157 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T04:05:21.183 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:21.240 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:21.378 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T04:05:21.404 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:21.445 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:21.496 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-09-16T04:05:21.523 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:21.562 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:21.602 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T04:05:21.628 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:21.660 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:21.857 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T04:05:21.884 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T04:05:21.948 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:21.967 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-09-16T04:05:21.982 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:22.016 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:22.264 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T04:05:22.267 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T04:05:22.283 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:22.288 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T04:05:22.290 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:22.302 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:22.326 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:22.330 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:22.336 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:22.498 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2024-09-16T04:05:22.524 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:22.564 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:22.697 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T04:05:22.724 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:22.763 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:23.067 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T04:05:23.093 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:23.125 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:23.325 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-09-16T04:05:23.347 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-babel. 2024-09-16T04:05:23.352 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:23.375 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:23.384 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph. 2024-09-16T04:05:23.391 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:23.410 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:23.414 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:23.450 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:23.512 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T04:05:23.538 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:23.578 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:23.669 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T04:05:23.696 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T04:05:23.727 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:23.733 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T04:05:23.736 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T04:05:23.752 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:23.761 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T04:05:23.786 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:23.800 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:05:23.964 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2024-09-16T04:05:23.991 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:24.030 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T04:05:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:24.128 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T04:05:24.131 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T04:05:24.144 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:24.158 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:24.177 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:24.197 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:24.336 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T04:05:24.360 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T04:05:24.399 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:24.514 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T04:05:24.542 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T04:05:24.581 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:24.626 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephadm. 2024-09-16T04:05:24.653 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:24.692 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:24.727 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T04:05:24.743 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:24.785 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:24.867 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-09-16T04:05:24.894 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T04:05:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:24.979 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T04:05:25.006 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T04:05:25.045 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:25.051 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-babel. 2024-09-16T04:05:25.075 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:25.109 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:25.228 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T04:05:25.245 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:25.278 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:25.390 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T04:05:25.405 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:25.431 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T04:05:25.448 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:25.458 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T04:05:25.497 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:05:25.799 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-babel. 2024-09-16T04:05:25.826 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:25.842 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T04:05:25.865 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:25.869 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:25.908 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:26.176 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T04:05:26.203 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T04:05:26.220 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T04:05:26.243 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:05:26.247 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T04:05:26.286 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:26.478 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-babel. 2024-09-16T04:05:26.483 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T04:05:26.494 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T04:05:26.500 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T04:05:26.528 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:26.541 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:26.581 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-09-16T04:05:26.587 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T04:05:26.608 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T04:05:26.615 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:26.647 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:26.654 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:26.814 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T04:05:26.830 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T04:05:26.872 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:05:26.965 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T04:05:26.984 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T04:05:26.992 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T04:05:27.013 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:27.032 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:27.050 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:27.062 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T04:05:27.089 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T04:05:27.128 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:27.184 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T04:05:27.211 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:27.250 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:27.335 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2024-09-16T04:05:27.361 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T04:05:27.401 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:27.498 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T04:05:27.526 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T04:05:27.537 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T04:05:27.564 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T04:05:27.581 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:27.604 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:27.746 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T04:05:27.773 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:27.812 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:27.834 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T04:05:27.862 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T04:05:27.890 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-routes. 2024-09-16T04:05:27.892 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:05:27.905 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T04:05:27.948 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:28.294 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T04:05:28.314 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T04:05:28.320 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:28.330 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T04:05:28.360 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:28.372 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:28.618 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T04:05:28.646 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:28.770 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:28.884 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T04:05:28.911 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T04:05:28.950 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:29.051 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T04:05:29.078 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T04:05:29.117 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:29.304 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T04:05:29.331 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T04:05:29.370 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:29.565 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T04:05:29.581 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T04:05:29.596 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T04:05:29.622 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T04:05:29.623 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:29.654 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:29.673 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T04:05:29.700 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T04:05:29.739 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:05:29.773 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T04:05:29.791 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T04:05:29.831 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:30.016 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T04:05:30.042 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T04:05:30.084 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:30.118 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T04:05:30.119 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T04:05:30.146 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T04:05:30.146 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T04:05:30.184 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:05:30.185 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:30.351 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T04:05:30.378 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T04:05:30.417 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:05:30.448 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T04:05:30.476 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:30.522 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T04:05:30.538 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T04:05:30.549 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T04:05:30.565 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T04:05:30.591 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:30.604 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:05:30.756 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:30.899 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T04:05:30.915 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T04:05:30.948 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T04:05:31.033 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T04:05:31.060 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T04:05:31.116 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:05:31.117 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T04:05:31.145 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:31.236 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T04:05:31.264 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T04:05:31.278 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:31.302 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T04:05:31.512 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T04:05:31.539 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T04:05:31.570 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:31.639 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T04:05:31.667 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T04:05:31.705 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:05:31.809 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T04:05:31.837 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:31.961 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:31.981 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T04:05:32.009 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T04:05:32.017 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T04:05:32.045 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T04:05:32.047 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:05:32.083 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T04:05:32.189 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T04:05:32.205 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T04:05:32.239 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:32.376 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T04:05:32.403 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T04:05:32.437 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T04:05:32.442 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:05:32.464 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T04:05:32.503 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:05:32.517 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T04:05:32.544 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T04:05:32.583 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:05:32.779 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T04:05:32.806 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T04:05:32.845 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T04:05:32.914 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T04:05:32.941 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T04:05:32.980 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:05:33.023 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T04:05:33.051 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T04:05:33.089 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:33.166 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T04:05:33.193 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T04:05:33.232 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T04:05:33.301 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T04:05:33.329 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:33.450 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:33.475 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T04:05:33.502 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T04:05:33.541 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T04:05:33.551 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T04:05:33.552 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T04:05:33.578 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T04:05:33.580 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T04:05:33.626 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:05:33.762 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T04:05:33.789 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T04:05:33.802 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:05:33.828 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:05:33.887 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T04:05:33.914 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T04:05:33.953 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T04:05:33.963 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T04:05:33.990 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T04:05:34.029 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:05:34.105 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T04:05:34.133 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T04:05:34.164 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T04:05:34.171 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T04:05:34.192 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:34.230 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:05:34.239 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T04:05:34.267 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T04:05:34.297 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:05:34.349 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T04:05:34.376 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T04:05:34.432 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T04:05:34.433 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-09-16T04:05:34.451 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:34.475 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T04:05:34.491 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T04:05:34.502 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T04:05:34.541 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:05:34.584 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T04:05:34.611 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T04:05:34.651 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T04:05:34.695 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T04:05:34.722 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T04:05:34.744 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-09-16T04:05:34.753 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T04:05:34.760 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T04:05:34.802 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:05:34.962 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T04:05:34.989 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T04:05:35.028 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:05:35.031 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T04:05:35.058 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T04:05:35.098 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:05:35.105 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T04:05:35.122 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T04:05:35.163 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:05:35.180 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T04:05:35.197 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:35.246 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:35.376 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T04:05:35.403 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T04:05:35.442 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T04:05:35.560 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-09-16T04:05:35.574 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T04:05:35.576 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:35.602 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T04:05:35.618 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:35.640 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:05:35.684 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T04:05:35.700 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:35.733 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:35.771 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T04:05:35.798 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T04:05:35.837 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:05:35.927 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T04:05:35.955 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:35.985 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:05:35.994 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T04:05:36.021 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T04:05:36.053 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:05:36.229 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-09-16T04:05:36.246 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:36.288 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T04:05:36.389 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T04:05:36.416 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:36.455 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:05:36.485 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T04:05:36.501 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:36.540 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-09-16T04:05:36.543 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:36.557 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T04:05:36.598 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:05:36.725 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2024-09-16T04:05:36.740 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:36.783 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T04:05:36.821 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T04:05:36.849 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T04:05:36.879 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:05:36.919 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T04:05:36.946 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T04:05:36.985 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:05:37.027 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2024-09-16T04:05:37.043 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T04:05:37.077 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:05:37.216 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T04:05:37.244 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:37.282 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:05:37.364 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T04:05:37.373 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-09-16T04:05:37.391 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T04:05:37.401 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:37.422 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:05:37.439 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:37.543 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package jq. 2024-09-16T04:05:37.571 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T04:05:37.610 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T04:05:37.750 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2024-09-16T04:05:37.766 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:37.801 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:37.863 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package socat. 2024-09-16T04:05:37.890 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T04:05:37.921 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:05:38.030 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T04:05:38.047 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:38.080 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:38.224 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T04:05:38.252 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T04:05:38.291 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:05:38.368 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T04:05:38.396 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:38.426 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:38.637 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-test. 2024-09-16T04:05:38.665 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:38.687 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T04:05:38.703 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:38.715 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T04:05:38.753 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:39.124 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T04:05:39.150 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T04:05:39.191 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:05:39.562 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T04:05:39.590 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T04:05:39.627 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T04:05:39.628 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:39.651 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:39.684 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:39.989 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T04:05:40.017 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:40.050 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pkg-config. 2024-09-16T04:05:40.055 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:40.078 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T04:05:40.113 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T04:05:40.116 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:05:40.141 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:40.171 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:40.324 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T04:05:40.341 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T04:05:40.374 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:40.377 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T04:05:40.394 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T04:05:40.436 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:40.450 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T04:05:40.466 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:40.500 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:40.695 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T04:05:40.723 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T04:05:40.762 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:05:40.786 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T04:05:40.813 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T04:05:40.852 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:40.864 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T04:05:40.892 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T04:05:40.930 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:41.000 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T04:05:41.028 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T04:05:41.099 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T04:05:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T04:05:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:41.183 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:41.199 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T04:05:41.226 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T04:05:41.233 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T04:05:41.261 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T04:05:41.264 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:05:41.299 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T04:05:41.554 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pkg-config. 2024-09-16T04:05:41.562 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T04:05:41.582 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T04:05:41.590 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:41.603 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T04:05:41.620 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:05:41.628 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:41.631 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T04:05:41.652 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T04:05:41.669 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:05:41.679 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T04:05:41.718 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:41.873 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T04:05:41.890 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T04:05:41.906 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T04:05:41.931 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T04:05:41.931 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:41.939 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T04:05:41.955 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T04:05:41.964 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:41.989 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:42.098 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pkg-config. 2024-09-16T04:05:42.126 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T04:05:42.156 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:05:42.295 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T04:05:42.308 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-09-16T04:05:42.322 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T04:05:42.337 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T04:05:42.343 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T04:05:42.361 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:05:42.371 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T04:05:42.375 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T04:05:42.376 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T04:05:42.404 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T04:05:42.409 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:42.467 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:42.696 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T04:05:42.704 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T04:05:42.724 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T04:05:42.724 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T04:05:42.732 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T04:05:42.751 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T04:05:42.762 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T04:05:42.770 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:42.789 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:42.837 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T04:05:42.864 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T04:05:42.895 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T04:05:43.127 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T04:05:43.165 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:05:43.190 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T04:05:43.207 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T04:05:43.212 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package pkg-config. 2024-09-16T04:05:43.217 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T04:05:43.235 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T04:05:43.239 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T04:05:43.256 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T04:05:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:43.278 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:05:43.468 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T04:05:43.484 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T04:05:43.514 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T04:05:43.517 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:43.530 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T04:05:43.559 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T04:05:43.573 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:43.587 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T04:05:43.602 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-toml. 2024-09-16T04:05:43.625 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:05:43.627 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T04:05:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T04:05:43.829 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-09-16T04:05:43.857 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T04:05:43.895 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T04:05:43.937 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T04:05:43.938 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T04:05:43.960 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T04:05:43.964 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T04:05:43.966 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T04:05:43.987 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T04:05:43.996 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:05:44.003 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:44.026 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:44.183 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T04:05:44.211 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T04:05:44.240 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:44.288 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T04:05:44.308 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T04:05:44.315 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T04:05:44.331 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2024-09-16T04:05:44.336 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T04:05:44.354 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T04:05:44.359 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T04:05:44.374 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:44.397 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T04:05:44.668 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T04:05:44.682 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T04:05:44.685 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T04:05:44.686 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T04:05:44.710 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T04:05:44.714 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T04:05:44.726 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T04:05:44.727 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:44.749 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:05:44.752 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:44.753 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T04:05:44.792 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:45.055 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-toml. 2024-09-16T04:05:45.069 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T04:05:45.083 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T04:05:45.096 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T04:05:45.121 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T04:05:45.155 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:45.196 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T04:05:45.212 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T04:05:45.246 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:45.408 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T04:05:45.428 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T04:05:45.466 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:05:45.473 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-09-16T04:05:45.480 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-py. 2024-09-16T04:05:45.501 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:45.508 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T04:05:45.532 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-toml. 2024-09-16T04:05:45.540 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:45.546 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T04:05:45.560 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T04:05:45.599 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T04:05:45.828 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T04:05:45.851 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T04:05:45.856 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T04:05:45.867 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T04:05:45.879 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T04:05:45.894 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:45.894 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T04:05:45.909 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:05:45.933 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:46.180 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T04:05:46.197 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T04:05:46.238 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:46.255 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T04:05:46.283 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T04:05:46.321 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:46.342 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T04:05:46.359 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:46.400 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:46.480 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T04:05:46.507 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T04:05:46.554 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:46.582 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T04:05:46.598 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T04:05:46.632 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:46.755 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:46.932 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-toml. 2024-09-16T04:05:46.960 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T04:05:47.001 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-09-16T04:05:47.007 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T04:05:47.013 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:05:47.029 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:47.067 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:47.139 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:47.344 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T04:05:47.371 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T04:05:47.386 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2024-09-16T04:05:47.410 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:05:47.413 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:47.435 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T04:05:47.452 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:47.756 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T04:05:47.780 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T04:05:47.808 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T04:05:47.847 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:47.878 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T04:05:47.895 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:47.928 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:48.116 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T04:05:48.132 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T04:05:48.174 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:48.194 INFO:teuthology.orchestra.run.smithi050.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T04:05:48.250 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:48.283 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:48.289 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T04:05:48.316 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:48.355 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:48.592 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:05:48.659 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:48.718 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:48.842 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-09-16T04:05:48.910 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:05:48.912 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package radosgw. 2024-09-16T04:05:48.940 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:48.978 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:49.032 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:49.035 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:49.084 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T04:05:49.297 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T04:05:49.435 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T04:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:49.658 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T04:05:49.773 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T04:05:49.785 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:49.789 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T04:05:49.823 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:49.875 INFO:teuthology.orchestra.run.smithi032.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T04:05:49.903 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:49.945 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:50.070 INFO:teuthology.orchestra.run.smithi196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T04:05:50.094 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T04:05:50.137 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:50.154 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:50.364 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T04:05:50.378 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-09-16T04:05:50.413 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:50.490 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T04:05:50.501 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:50.540 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T04:05:50.620 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2024-09-16T04:05:50.735 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:50.752 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T04:05:50.785 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:50.866 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:51.003 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:51.036 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:51.063 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T04:05:51.162 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:51.243 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:51.245 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:51.389 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:51.413 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:51.475 INFO:teuthology.orchestra.run.smithi204.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T04:05:51.495 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T04:05:51.640 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:51.681 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:51.754 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:51.799 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T04:05:51.891 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:51.972 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:52.017 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T04:05:52.092 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:52.102 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:52.232 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:52.326 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:52.478 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:52.491 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:52.634 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user cephadm....done 2024-09-16T04:05:52.686 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:52.729 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T04:05:52.766 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T04:05:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:52.921 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T04:05:52.997 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:53.042 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T04:05:53.043 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:53.153 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:53.198 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:53.253 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:53.256 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:53.301 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T04:05:53.363 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:53.411 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T04:05:53.474 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:53.516 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:53.622 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:53.662 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T04:05:53.792 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:53.914 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T04:05:54.013 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T04:05:54.015 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:54.040 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T04:05:54.044 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T04:05:54.060 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:54.109 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:05:54.252 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:54.284 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:54.319 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:54.366 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T04:05:54.445 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:54.571 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:54.619 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:54.635 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:54.697 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:54.726 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T04:05:54.745 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T04:05:54.903 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:54.965 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:54.978 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T04:05:55.013 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:55.020 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:55.130 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:55.240 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:55.254 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T04:05:55.289 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:55.336 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T04:05:55.371 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T04:05:55.434 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:05:55.506 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T04:05:55.515 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:55.598 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T04:05:55.740 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T04:05:55.741 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:55.904 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T04:05:55.920 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:55.938 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T04:05:56.002 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:05:56.016 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T04:05:56.063 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T04:05:56.111 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:56.267 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:56.339 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:56.453 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:56.460 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:56.527 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T04:05:56.563 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T04:05:56.615 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:56.644 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T04:05:56.711 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:56.754 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T04:05:56.814 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:56.837 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:56.881 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T04:05:56.899 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T04:05:56.963 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:05:57.000 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:57.082 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:57.131 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T04:05:57.264 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:57.383 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T04:05:57.509 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:57.583 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T04:05:57.612 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T04:05:57.668 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T04:05:57.673 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:57.677 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:57.819 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T04:05:57.933 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:57.936 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:58.062 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:58.161 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:58.178 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T04:05:58.197 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:05:58.296 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T04:05:58.312 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:05:58.412 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:05:58.506 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:58.521 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:05:58.556 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T04:05:58.603 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:05:58.647 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:05:58.799 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T04:05:58.891 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:58.948 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T04:05:58.954 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:05:59.100 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T04:05:59.134 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:59.205 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:05:59.226 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T04:05:59.331 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:05:59.349 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T04:05:59.535 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:05:59.600 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:05:59.640 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:05:59.820 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:05:59.903 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T04:05:59.967 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:05:59.985 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:06:00.146 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T04:06:00.196 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:06:00.252 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:06:00.272 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T04:06:00.398 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T04:06:00.455 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:06:00.587 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:06:00.590 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:00.707 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T04:06:00.822 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:06:00.883 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:06:00.948 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:01.084 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T04:06:01.209 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:06:01.266 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:06:01.266 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:06:01.343 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T04:06:01.501 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:01.583 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:06:01.636 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T04:06:01.720 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T04:06:01.903 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:06:02.005 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T04:06:02.029 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:06:02.156 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:06:02.339 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T04:06:02.448 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:06:02.457 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:06:02.590 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T04:06:02.699 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:02.705 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:06:02.725 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T04:06:02.733 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:02.850 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T04:06:02.957 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:02.967 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:03.026 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T04:06:03.068 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:06:03.091 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T04:06:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:06:03.236 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:06:03.344 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T04:06:03.345 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:06:03.367 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:06:03.493 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:06:03.612 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:06:03.619 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:06:03.646 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:06:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T04:06:03.904 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:06:03.905 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T04:06:04.131 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T04:06:04.155 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T04:06:04.157 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:04.266 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:06:04.416 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:06:04.447 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:04.500 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T04:06:04.574 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:06:04.651 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:06:04.683 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T04:06:04.752 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:04.875 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:06:04.877 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T04:06:04.942 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:06:05.043 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T04:06:05.126 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T04:06:05.137 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T04:06:05.198 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T04:06:05.264 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T04:06:05.337 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:06:05.385 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T04:06:05.389 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T04:06:05.445 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T04:06:05.446 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:06:05.628 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:06:05.704 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:06:05.716 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T04:06:05.747 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:06:05.871 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T04:06:05.955 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T04:06:05.984 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T04:06:06.048 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:06:06.121 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:06:06.223 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:06:06.235 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:06.247 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T04:06:06.308 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:06:06.332 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T04:06:06.361 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T04:06:06.409 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:06:06.510 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:06:06.532 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:06:06.583 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T04:06:06.608 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:06:06.658 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:06:06.662 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T04:06:06.718 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:06:06.829 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:06:06.905 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T04:06:06.938 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:06:06.950 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:06:07.027 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:06:07.156 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T04:06:07.260 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:06:07.337 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:06:07.364 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:06:07.425 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T04:06:07.530 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:06:07.596 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:06:07.628 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:06:07.632 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T04:06:07.700 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T04:06:07.738 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:06:07.755 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:06:07.758 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T04:06:07.812 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T04:06:07.890 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:06:07.976 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T04:06:07.979 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T04:06:08.009 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:08.056 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:06:08.102 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T04:06:08.110 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:06:08.182 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:06:08.225 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:06:08.326 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:06:08.378 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T04:06:08.453 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:06:08.496 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T04:06:08.575 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:06:08.719 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:06:08.771 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:06:08.781 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T04:06:08.834 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T04:06:08.935 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T04:06:08.961 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T04:06:09.055 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T04:06:09.074 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T04:06:09.087 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T04:06:09.178 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:09.181 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T04:06:09.292 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:06:09.325 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T04:06:09.347 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:09.451 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T04:06:09.457 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T04:06:09.481 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:06:09.577 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T04:06:09.666 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T04:06:09.734 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:06:09.799 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:06:09.838 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:06:09.903 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T04:06:10.038 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T04:06:10.092 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:06:10.104 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:06:10.148 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:06:10.376 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T04:06:10.415 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T04:06:10.424 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T04:06:10.489 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T04:06:10.502 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T04:06:10.550 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T04:06:10.674 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T04:06:10.778 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T04:06:10.782 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:06:10.800 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T04:06:10.817 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T04:06:11.059 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T04:06:11.063 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:06:11.085 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:06:11.152 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:06:11.186 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T04:06:11.270 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:11.396 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:11.416 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:06:11.422 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:06:11.495 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T04:06:11.522 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:06:11.780 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T04:06:11.793 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T04:06:11.815 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T04:06:11.858 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:11.959 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.048 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T04:06:12.068 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T04:06:12.111 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:06:12.117 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:06:12.157 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T04:06:12.345 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.425 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T04:06:12.444 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:06:12.463 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:06:12.471 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.562 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.616 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.616 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.692 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T04:06:12.696 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.718 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:12.822 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:06:12.834 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:12.835 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:12.844 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:06:13.057 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T04:06:13.180 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.183 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.301 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.306 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.307 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.402 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T04:06:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T04:06:13.432 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T04:06:13.433 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.534 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.635 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:06:13.661 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.701 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.724 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T04:06:13.763 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.819 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.881 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:13.928 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.086 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T04:06:14.094 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:14.094 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:14.147 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:14.148 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:14.212 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.363 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.481 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T04:06:14.548 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.654 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.780 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.792 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.906 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.918 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.922 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:14.934 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:06:15.032 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:06:15.048 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.052 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T04:06:15.175 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.284 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.329 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.385 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.464 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.590 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:15.824 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:15.824 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T04:06:15.962 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-09-16T04:06:16.121 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.247 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.278 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.308 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.355 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-09-16T04:06:16.373 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.404 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.434 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.490 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-09-16T04:06:16.499 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.505 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T04:06:16.530 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.560 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.625 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.651 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T04:06:16.656 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:16.686 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T04:06:16.782 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:17.024 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T04:06:17.151 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2024-09-16T04:06:17.258 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-09-16T04:06:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:17.537 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2024-09-16T04:06:17.577 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-09-16T04:06:17.613 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:17.721 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2024-09-16T04:06:17.729 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-09-16T04:06:17.736 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T04:06:17.748 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T04:06:17.874 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T04:06:17.891 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T04:06:17.898 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.024 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.069 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:18.069 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:18.150 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.213 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T04:06:18.217 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T04:06:18.276 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.402 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.548 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.684 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.709 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.785 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.827 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:18.912 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T04:06:18.920 INFO:teuthology.orchestra.run.smithi204.stdout:Adding group ceph....done 2024-09-16T04:06:19.218 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:19.218 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:19.297 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user ceph....done 2024-09-16T04:06:19.337 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:19.337 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:19.417 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:19.465 INFO:teuthology.orchestra.run.smithi204.stdout:Setting system user ceph properties....done 2024-09-16T04:06:19.485 INFO:teuthology.orchestra.run.smithi204.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T04:06:19.620 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T04:06:19.664 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:19.664 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:19.681 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:19.820 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:19.931 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T04:06:20.030 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T04:06:20.152 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:20.189 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T04:06:20.371 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:20.371 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:20.493 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:20.505 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:20.706 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:20.784 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:20.784 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:20.862 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:20.914 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:20.914 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:20.949 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:20.949 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T04:06:21.145 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:21.145 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:21.264 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:21.390 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:21.391 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:21.488 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:21.488 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:21.618 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:21.619 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:21.622 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:21.731 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:21.745 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T04:06:21.882 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:21.971 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.076 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.099 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:22.100 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:22.200 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.242 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:22.242 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:22.351 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:22.430 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:22.430 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T04:06:22.567 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.709 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.756 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.819 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.852 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.882 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.979 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:22.979 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.033 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.124 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.129 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.247 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:23.247 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:23.340 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:23.340 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T04:06:23.340 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T04:06:23.348 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:23.348 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:23.457 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T04:06:23.610 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T04:06:23.717 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.787 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.814 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.843 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.953 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:23.965 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.065 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:24.065 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T04:06:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.103 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.268 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.457 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T04:06:24.497 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.565 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T04:06:24.623 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.646 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T04:06:24.686 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T04:06:24.763 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T04:06:24.774 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:24.868 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T04:06:24.916 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T04:06:24.988 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:24.988 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T04:06:25.372 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T04:06:25.378 DEBUG:teuthology.parallel:result is None 2024-09-16T04:06:25.476 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:25.618 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:25.736 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T04:06:25.744 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:25.895 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T04:06:26.052 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T04:06:26.257 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T04:06:26.358 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T04:06:26.413 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T04:06:26.418 DEBUG:teuthology.parallel:result is None 2024-09-16T04:06:26.510 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T04:06:26.745 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T04:06:26.749 DEBUG:teuthology.parallel:result is None 2024-09-16T04:06:27.845 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T04:06:28.601 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T04:06:28.605 DEBUG:teuthology.parallel:result is None 2024-09-16T04:06:28.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:06:28.755 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-09-16T04:06:28.775 INFO:teuthology.orchestra.run.smithi032.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:28.776 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:28.777 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T04:06:28.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:06:28.921 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-09-16T04:06:28.941 INFO:teuthology.orchestra.run.smithi050.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:28.942 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:28.942 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T04:06:28.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:06:29.083 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2024-09-16T04:06:29.102 INFO:teuthology.orchestra.run.smithi196.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:29.102 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:29.102 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T04:06:29.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T04:06:29.245 DEBUG:teuthology.orchestra.run.smithi204:> dpkg-query -W -f '${Version}' ceph 2024-09-16T04:06:29.265 INFO:teuthology.orchestra.run.smithi204.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:29.265 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T04:06:29.265 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T04:06:29.267 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T04:06:29.267 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:29.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T04:06:29.282 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:29.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T04:06:29.296 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:29.296 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T04:06:29.310 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:29.311 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T04:06:29.325 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T04:06:29.326 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:29.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T04:06:29.339 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T04:06:29.393 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:29.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T04:06:29.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T04:06:29.461 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:29.461 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T04:06:29.474 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T04:06:29.528 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:29.529 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T04:06:29.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T04:06:29.596 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T04:06:29.597 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:29.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T04:06:29.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T04:06:29.666 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:29.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T04:06:29.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T04:06:29.734 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:29.734 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T04:06:29.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T04:06:29.801 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:29.801 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T04:06:29.815 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T04:06:29.869 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T04:06:29.869 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:29.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T04:06:29.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T04:06:29.937 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:29.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T04:06:29.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T04:06:30.006 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:30.006 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T04:06:30.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T04:06:30.074 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:30.074 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T04:06:30.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T04:06:30.140 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T04:06:30.219 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T04:06:30.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-09-16T04:06:30.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-09-16T04:06:30.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-09-16T04:06:30.227 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-09-16T04:06:30.239 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T04:06:30.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T04:06:30.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T04:06:30.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T04:06:30.283 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T04:06:30.296 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T04:06:30.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T04:06:30.335 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T04:06:30.337 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T04:06:30.339 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T04:06:30.363 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T04:06:30.364 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'osd_object_clean_region_max_num_intervals': 1000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T04:06:30.364 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958', 'branch': 'squid', 'description': 'rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7905958', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'osd_object_clean_region_max_num_intervals': 1000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 700, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 5616, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '15927/100000', 'suite': 'rados', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzy5nHHYBwdb93Y8Akf6FbnWQT7XNsoW7i67tDQly6TmtV0msMEGTuAFS6i+lBUz0iV34OJ7BAYsoNw+6H3UhY=', 'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8hWYK1MOwXxbvoHqM/fBVyfjzbPDDcqt8EVUSdi/gMKg4/gqeSlCf6uXewITuBsWYT29Kz2Qxhr8l5IbpYJYs=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEk0FPI4TClcXZmkRdJdARY7SjQ3wE4i6iIiRIapX2Zo82P61yAv8E5nk/kP38GCEHvnCCuQTZpHIQv7SPjU4Ok=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7kq/BoonxSy0N+Ht7arvf20m4kdHMOiahNFjT6wy+MY/0NFrk2wbjgE7pmQBPa4APM2/gDsMvWJ+aWcCvmR0c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'osd_object_clean_region_max_num_intervals': 1000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'thrashosds': {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:00:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T04:06:30.364 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T04:06:30.391 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T04:06:30.393 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T04:06:30.396 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T04:06:30.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T04:06:30.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T04:06:30.441 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T04:06:30.444 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T04:06:30.457 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:30.457 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T04:06:30.498 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T04:06:30.498 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-09-16T04:06:30.546 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T04:06:30.546 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:30.546 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-16T04:06:30.546 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:30.546 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-16 04:00:51.590329508 +0000 2024-09-16T04:06:30.547 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-16 04:00:51.298295616 +0000 2024-09-16T04:06:30.547 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-16 04:00:51.298295616 +0000 2024-09-16T04:06:30.547 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-16T04:06:30.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T04:06:30.600 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-16T04:06:30.601 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-16T04:06:30.601 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000248263 s, 2.1 MB/s 2024-09-16T04:06:30.602 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T04:06:30.652 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-09-16T04:06:30.698 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T04:06:30.698 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:30.699 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-16T04:06:30.699 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:30.699 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-16 04:00:51.806354579 +0000 2024-09-16T04:06:30.699 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-16 04:00:51.802354113 +0000 2024-09-16T04:06:30.699 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-16 04:00:51.802354113 +0000 2024-09-16T04:06:30.699 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-16T04:06:30.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T04:06:30.753 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-16T04:06:30.753 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-16T04:06:30.753 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000314502 s, 1.6 MB/s 2024-09-16T04:06:30.754 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T04:06:30.807 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-09-16T04:06:30.854 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T04:06:30.854 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:30.854 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-16T04:06:30.854 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:30.855 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-16 04:00:52.546438309 +0000 2024-09-16T04:06:30.855 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-16 04:00:52.314412309 +0000 2024-09-16T04:06:30.855 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-16 04:00:52.314412309 +0000 2024-09-16T04:06:30.855 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-16T04:06:30.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T04:06:30.908 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-16T04:06:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-16T04:06:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000302286 s, 1.7 MB/s 2024-09-16T04:06:30.910 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T04:06:30.959 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-16 04:00:53.026492040 +0000 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-16 04:00:52.762462515 +0000 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-16 04:00:52.762462515 +0000 2024-09-16T04:06:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-16T04:06:31.007 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T04:06:31.060 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-16T04:06:31.061 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-16T04:06:31.061 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000307852 s, 1.7 MB/s 2024-09-16T04:06:31.062 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T04:06:31.111 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:31.112 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:31.112 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T04:06:31.118 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T04:06:31.118 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-16T04:06:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T04:06:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.166 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-16T04:06:31.166 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.167 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-16 04:00:52.609501858 +0000 2024-09-16T04:06:31.167 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-16 04:00:52.349504170 +0000 2024-09-16T04:06:31.167 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-16 04:00:52.349504170 +0000 2024-09-16T04:06:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-16T04:06:31.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T04:06:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-16T04:06:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-16T04:06:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000284541 s, 1.8 MB/s 2024-09-16T04:06:31.222 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T04:06:31.271 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-16T04:06:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T04:06:31.318 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.318 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-16T04:06:31.318 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.319 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-16 04:00:52.813500045 +0000 2024-09-16T04:06:31.319 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-16 04:00:52.809500081 +0000 2024-09-16T04:06:31.319 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-16 04:00:52.809500081 +0000 2024-09-16T04:06:31.319 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-16T04:06:31.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T04:06:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-16T04:06:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-16T04:06:31.372 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000205066 s, 2.5 MB/s 2024-09-16T04:06:31.374 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T04:06:31.423 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-16T04:06:31.470 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T04:06:31.470 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.470 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-16T04:06:31.471 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.471 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-16 04:00:53.573493289 +0000 2024-09-16T04:06:31.471 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-16 04:00:53.317495566 +0000 2024-09-16T04:06:31.471 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-16 04:00:53.317495566 +0000 2024-09-16T04:06:31.471 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-16T04:06:31.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T04:06:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-16T04:06:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-16T04:06:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000202649 s, 2.5 MB/s 2024-09-16T04:06:31.534 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T04:06:31.584 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-16T04:06:31.634 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T04:06:31.634 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.634 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-16T04:06:31.634 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.635 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-16 04:00:54.057488987 +0000 2024-09-16T04:06:31.635 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-16 04:00:53.797491299 +0000 2024-09-16T04:06:31.635 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-16 04:00:53.797491299 +0000 2024-09-16T04:06:31.635 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-16T04:06:31.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T04:06:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-16T04:06:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-16T04:06:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000293252 s, 1.7 MB/s 2024-09-16T04:06:31.690 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T04:06:31.739 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:31.739 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:31.739 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T04:06:31.745 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T04:06:31.745 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-09-16T04:06:31.794 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-16 04:00:46.486970522 +0000 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-16 04:00:46.218972910 +0000 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-16 04:00:46.218972910 +0000 2024-09-16T04:06:31.795 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-16T04:06:31.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T04:06:31.848 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-16T04:06:31.849 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-16T04:06:31.849 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000432994 s, 1.2 MB/s 2024-09-16T04:06:31.850 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T04:06:31.899 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-09-16T04:06:31.945 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T04:06:31.945 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:31.946 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-16T04:06:31.946 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:31.946 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-16 04:00:46.710968525 +0000 2024-09-16T04:06:31.946 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-16 04:00:46.706968562 +0000 2024-09-16T04:06:31.946 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-16 04:00:46.706968562 +0000 2024-09-16T04:06:31.946 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-16T04:06:31.946 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T04:06:31.999 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-16T04:06:31.999 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-16T04:06:32.000 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000352406 s, 1.5 MB/s 2024-09-16T04:06:32.001 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T04:06:32.051 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-09-16T04:06:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T04:06:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:32.102 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-16T04:06:32.102 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:32.102 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-16 04:00:47.442962003 +0000 2024-09-16T04:06:32.102 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-16 04:00:47.182964321 +0000 2024-09-16T04:06:32.102 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-16 04:00:47.182964321 +0000 2024-09-16T04:06:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-16T04:06:32.102 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T04:06:32.155 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-16T04:06:32.155 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-16T04:06:32.156 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000347912 s, 1.5 MB/s 2024-09-16T04:06:32.156 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T04:06:32.203 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-09-16T04:06:32.249 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-16 04:00:47.702959687 +0000 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-16 04:00:47.698959723 +0000 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-16 04:00:47.698959723 +0000 2024-09-16T04:06:32.250 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-16T04:06:32.250 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T04:06:32.304 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-16T04:06:32.304 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-16T04:06:32.304 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000387434 s, 1.3 MB/s 2024-09-16T04:06:32.305 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T04:06:32.355 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:32.355 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:32.355 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T04:06:32.361 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T04:06:32.361 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-09-16T04:06:32.410 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T04:06:32.410 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-16T04:06:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:32.411 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-16 04:00:46.401298169 +0000 2024-09-16T04:06:32.411 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-16 04:00:46.165300277 +0000 2024-09-16T04:06:32.411 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-16 04:00:46.165300277 +0000 2024-09-16T04:06:32.411 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-16T04:06:32.411 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T04:06:32.465 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-16T04:06:32.465 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-16T04:06:32.465 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000385746 s, 1.3 MB/s 2024-09-16T04:06:32.466 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T04:06:32.515 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-09-16T04:06:32.561 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-16 04:00:46.881293881 +0000 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-16 04:00:46.625296168 +0000 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-16 04:00:46.625296168 +0000 2024-09-16T04:06:32.562 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-16T04:06:32.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T04:06:32.616 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-16T04:06:32.616 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-16T04:06:32.616 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.0004179 s, 1.2 MB/s 2024-09-16T04:06:32.617 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T04:06:32.667 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-09-16T04:06:32.714 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T04:06:32.714 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:32.714 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-16T04:06:32.715 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:32.715 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-16 04:00:47.377289451 +0000 2024-09-16T04:06:32.715 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-16 04:00:47.117291773 +0000 2024-09-16T04:06:32.715 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-16 04:00:47.117291773 +0000 2024-09-16T04:06:32.715 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-16T04:06:32.715 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T04:06:32.768 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-16T04:06:32.769 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-16T04:06:32.769 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000431703 s, 1.2 MB/s 2024-09-16T04:06:32.770 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T04:06:32.819 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-16 04:00:47.857285164 +0000 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-16 04:00:47.609287379 +0000 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-16 04:00:47.609287379 +0000 2024-09-16T04:06:32.866 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-16T04:06:32.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T04:06:32.920 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-16T04:06:32.920 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-16T04:06:32.920 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000413867 s, 1.2 MB/s 2024-09-16T04:06:32.921 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T04:06:32.971 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:32.971 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-16T04:06:32.971 INFO:tasks.ceph:Generating config... 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T04:06:32.973 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.1 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-16T04:06:32.974 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-16T04:06:32.975 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T04:06:32.975 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-16T04:06:32.975 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-16T04:06:32.975 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-16T04:06:32.975 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-16T04:06:32.975 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T04:06:32.975 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-16T04:06:32.975 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-16T04:06:32.975 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-16T04:06:32.975 INFO:tasks.ceph:[global] osd_object_clean_region_max_num_intervals = 1000 2024-09-16T04:06:32.975 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T04:06:32.975 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T04:06:32.975 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T04:06:32.976 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T04:06:32.976 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T04:06:32.976 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-16T04:06:32.976 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T04:06:32.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T04:06:33.012 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T04:06:33.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T04:06:33.122 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T04:06:33.179 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.50'), ('mon.c', '172.21.15.196')] 2024-09-16T04:06:33.179 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.50,172.21.15.196', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'osd_object_clean_region_max_num_intervals': 1000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2024-09-16T04:06:33.180 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:33.180 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T04:06:33.226 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.50 --add c 172.21.15.196 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:33.312 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:33.312 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:06:33.312 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = quincy 2024-09-16T04:06:33.312 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-09-16T04:06:33.312 INFO:teuthology.orchestra.run.smithi032.stdout:fsid d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:06:33.312 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-09-16T04:06:33.312969+0000 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-09-16T04:06:33.312969+0000 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 17 (quincy) 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 3 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-09-16T04:06:33.313 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T04:06:33.314 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T04:06:33.362 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d778dcff-91d6-4620-92b2-10f7b308093f... 2024-09-16T04:06:33.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T04:06:33.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T04:06:33.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T04:06:33.412 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T04:06:33.437 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-09-16T04:06:33.437 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-09-16T04:06:33.437 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T04:06:33.437 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-09-16T04:06:33.437 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-09-16T04:06:33.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-09-16T04:06:33.439 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-09-16T04:06:33.440 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.50,172.21.15.196" 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: mon client directed command retry = 5 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: mon election default strategy = 3 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject socket failures = 5000 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: osd_object_clean_region_max_num_intervals = 1000 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 120 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-09-16T04:06:33.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-09-16T04:06:33.442 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: debug monc = 20 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2024-09-16T04:06:33.443 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore zero block detection = True 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 20 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 20 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 10 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: osd blocked scrub grace period = 3600 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug reject backfill probability = 0.1 2024-09-16T04:06:33.444 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify cached snaps = True 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify missing on start = True 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd heartbeat use min delay socket = True 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd max backfills = 3 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd max markdown count = 1000 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock override recovery settings = True 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd op queue = debug_random 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd op queue cut off = debug_random 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub min interval = 60 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: osd shutdown pgref assert = True 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.445 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-09-16T04:06:33.446 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T04:06:33.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: mon scrub interval = 300 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-09-16T04:06:33.448 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-09-16T04:06:33.449 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T04:06:33.449 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T04:06:33.449 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-09-16T04:06:33.449 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-09-16T04:06:33.449 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-09-16T04:06:33.450 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.451 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-09-16T04:06:33.451 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.451 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-09-16T04:06:33.452 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-09-16T04:06:33.452 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.452 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-09-16T04:06:33.452 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-09-16T04:06:33.453 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-09-16T04:06:33.454 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.32,172.21.15.50,172.21.15.196" 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: mon client directed command retry = 5 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: mon election default strategy = 3 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: ms inject socket failures = 5000 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: osd_object_clean_region_max_num_intervals = 1000 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 120 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-09-16T04:06:33.455 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-09-16T04:06:33.456 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.457 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-09-16T04:06:33.457 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-09-16T04:06:33.457 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.457 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-09-16T04:06:33.457 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.457 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: debug monc = 20 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-09-16T04:06:33.458 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore zero block detection = True 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: osd blocked scrub grace period = 3600 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug reject backfill probability = 0.1 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify cached snaps = True 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify missing on start = True 2024-09-16T04:06:33.459 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd heartbeat use min delay socket = True 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd max backfills = 3 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd max markdown count = 1000 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock override recovery settings = True 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd op queue = debug_random 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd op queue cut off = debug_random 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub min interval = 60 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: osd shutdown pgref assert = True 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-09-16T04:06:33.460 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-09-16T04:06:33.461 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T04:06:33.462 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: mon scrub interval = 300 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T04:06:33.463 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-09-16T04:06:33.464 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-09-16T04:06:33.464 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-09-16T04:06:33.465 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-09-16T04:06:33.465 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-09-16T04:06:33.465 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T04:06:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-09-16T04:06:33.467 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.32,172.21.15.50,172.21.15.196" 2024-09-16T04:06:33.468 INFO:teuthology.orchestra.run.smithi196.stdout: mon client directed command retry = 5 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: mon election default strategy = 3 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: ms inject socket failures = 5000 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: osd_object_clean_region_max_num_intervals = 1000 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.469 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 120 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-09-16T04:06:33.470 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: debug monc = 20 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-09-16T04:06:33.471 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore zero block detection = True 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 20 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 20 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 10 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: osd blocked scrub grace period = 3600 2024-09-16T04:06:33.472 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug reject backfill probability = 0.1 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify cached snaps = True 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify missing on start = True 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd heartbeat use min delay socket = True 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd max backfills = 3 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd max markdown count = 1000 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock override recovery settings = True 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd op queue = debug_random 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd op queue cut off = debug_random 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub min interval = 60 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd shutdown pgref assert = True 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.473 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-09-16T04:06:33.474 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-09-16T04:06:33.475 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: mon scrub interval = 300 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-09-16T04:06:33.476 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.477 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-16T04:06:33.478 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.479 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.32,172.21.15.50,172.21.15.196" 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: mon client directed command retry = 5 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: mon election default strategy = 3 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject socket failures = 5000 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: osd_object_clean_region_max_num_intervals = 1000 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.480 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 120 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-16T04:06:33.481 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: debug monc = 20 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-09-16T04:06:33.482 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore zero block detection = True 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: osd blocked scrub grace period = 3600 2024-09-16T04:06:33.483 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug reject backfill probability = 0.1 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify cached snaps = True 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify missing on start = True 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd heartbeat use min delay socket = True 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd max backfills = 3 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd max markdown count = 1000 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock override recovery settings = True 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd op queue = debug_random 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd op queue cut off = debug_random 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub min interval = 60 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: osd shutdown pgref assert = True 2024-09-16T04:06:33.484 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-16T04:06:33.485 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T04:06:33.486 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: mon scrub interval = 300 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T04:06:33.487 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-16T04:06:33.488 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-16T04:06:33.488 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-16T04:06:33.490 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T04:06:33.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T04:06:33.562 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T04:06:33.562 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:33.562 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T04:06:33.568 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:33.568 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T04:06:33.614 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:06:33.614 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:33.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T04:06:33.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T04:06:33.680 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:06:33.680 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:33.726 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:06:33.728 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:33.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T04:06:33.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T04:06:33.751 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:06:33.751 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:33.798 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:06:33.798 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:33.798 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T04:06:33.798 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T04:06:33.820 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:06:33.821 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:33.869 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:06:33.870 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:33.870 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T04:06:33.870 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T04:06:33.895 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:06:33.895 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:33.942 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T04:06:33.943 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T04:06:33.943 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T04:06:33.988 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T04:06:33.991 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T04:06:34.035 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T04:06:34.047 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T04:06:34.047 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T04:06:34.047 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T04:06:34.120 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T04:06:34.130 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T04:06:34.130 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-16T04:06:34.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T04:06:34.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:34.145 INFO:tasks.ceph:role: osd.0 2024-09-16T04:06:34.145 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:06:34.145 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:34.202 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:34.203 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:34.203 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:34.203 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:34.228 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-16T04:06:34.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-16T04:06:34.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T04:06:34.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T04:06:34.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:34.345 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:34.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T04:06:34.403 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:34.403 INFO:tasks.ceph:role: osd.4 2024-09-16T04:06:34.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:06:34.404 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T04:06:34.458 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:34.458 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:34.458 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:34.459 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:34.459 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:34.459 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:34.459 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:34.459 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:34.460 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:34.460 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:34.482 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-16T04:06:34.484 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-16T04:06:34.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-16T04:06:34.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T04:06:34.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:34.598 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:34.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-09-16T04:06:34.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:34.653 INFO:tasks.ceph:role: osd.8 2024-09-16T04:06:34.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:06:34.653 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:34.706 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:34.707 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:34.707 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:34.707 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:34.730 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-16T04:06:34.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-16T04:06:34.731 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-09-16T04:06:34.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-09-16T04:06:34.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:34.843 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:34.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2024-09-16T04:06:34.897 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:34.897 INFO:tasks.ceph:role: osd.12 2024-09-16T04:06:34.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:06:34.897 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T04:06:34.953 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:34.953 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:34.953 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:34.954 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:34.977 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-16T04:06:34.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-16T04:06:34.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2024-09-16T04:06:35.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2024-09-16T04:06:35.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:35.095 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:35.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:35.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:35.197+0000 7f4c624867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T04:06:35.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:35.197+0000 7f4c624867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T04:06:35.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:35.197+0000 7f4c624867c0 -1 bdev(0x56526ee0b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:35.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:35.197+0000 7f4c624867c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T04:06:38.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T04:06:38.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:38.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:38.681+0000 7fb6ba0ec7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T04:06:38.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:38.681+0000 7fb6ba0ec7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T04:06:38.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:38.681+0000 7fb6ba0ec7c0 -1 bdev(0x556f0f413800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:38.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:38.681+0000 7fb6ba0ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T04:06:41.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T04:06:41.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:41.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:41.989+0000 7f224039e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-09-16T04:06:41.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:41.989+0000 7f224039e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-09-16T04:06:41.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:41.989+0000 7f224039e7c0 -1 bdev(0x55c09669b800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:41.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:41.989+0000 7f224039e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-09-16T04:06:45.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-09-16T04:06:45.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:45.529+0000 7fa7f36337c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2024-09-16T04:06:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:45.529+0000 7fa7f36337c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2024-09-16T04:06:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:45.529+0000 7fa7f36337c0 -1 bdev(0x5563e4051800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:45.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:06:45.529+0000 7fa7f36337c0 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2024-09-16T04:06:48.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2024-09-16T04:06:48.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T04:06:49.015 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:49.015 INFO:tasks.ceph:role: osd.1 2024-09-16T04:06:49.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:06:49.015 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T04:06:49.069 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:49.069 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:49.070 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:49.095 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-16T04:06:49.097 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-16T04:06:49.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-16T04:06:49.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T04:06:49.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:49.212 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:49.212 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T04:06:49.265 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:49.265 INFO:tasks.ceph:role: osd.5 2024-09-16T04:06:49.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:06:49.265 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:49.346 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-16T04:06:49.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-16T04:06:49.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-16T04:06:49.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T04:06:49.459 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:49.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:49.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-09-16T04:06:49.514 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:49.514 INFO:tasks.ceph:role: osd.9 2024-09-16T04:06:49.514 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:06:49.514 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:49.571 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:49.594 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-16T04:06:49.595 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-16T04:06:49.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2024-09-16T04:06:49.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-09-16T04:06:49.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:49.708 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:49.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2024-09-16T04:06:49.762 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-16T04:06:49.763 INFO:tasks.ceph:role: osd.13 2024-09-16T04:06:49.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:06:49.763 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T04:06:49.817 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:06:49.818 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:06:49.842 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-16T04:06:49.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-16T04:06:49.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2024-09-16T04:06:49.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2024-09-16T04:06:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:06:49.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:06:49.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:50.052+0000 7f29ef87e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T04:06:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:50.056+0000 7f29ef87e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T04:06:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:50.056+0000 7f29ef87e7c0 -1 bdev(0x55723215f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:50.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:50.056+0000 7f29ef87e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T04:06:53.456 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T04:06:53.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:53.552+0000 7fa05f3877c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T04:06:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:53.552+0000 7fa05f3877c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T04:06:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:53.552+0000 7fa05f3877c0 -1 bdev(0x55bfa24eb800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:53.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:53.552+0000 7fa05f3877c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T04:06:56.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T04:06:56.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:06:57.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:57.080+0000 7f14a986f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-09-16T04:06:57.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:57.080+0000 7f14a986f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-09-16T04:06:57.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:57.080+0000 7f14a986f7c0 -1 bdev(0x556c8e877800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:57.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:06:57.080+0000 7f14a986f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-09-16T04:07:00.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-09-16T04:07:00.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:07:00.884+0000 7fdb169157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2024-09-16T04:07:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:07:00.884+0000 7fdb169157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2024-09-16T04:07:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:07:00.884+0000 7fdb169157c0 -1 bdev(0x56052adad800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-16T04:07:00.884+0000 7fdb169157c0 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2024-09-16T04:07:04.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2024-09-16T04:07:04.095 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T04:07:04.109 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:04.110 INFO:tasks.ceph:role: osd.2 2024-09-16T04:07:04.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:07:04.110 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T04:07:04.173 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:04.173 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:04.173 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:04.173 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:04.173 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:04.174 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:04.174 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:04.174 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:04.174 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:04.174 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:04.657 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-16T04:07:04.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-16T04:07:04.659 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T04:07:04.812 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T04:07:04.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:04.824 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:04.824 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-16T04:07:04.885 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:04.885 INFO:tasks.ceph:role: osd.6 2024-09-16T04:07:04.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:07:04.886 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:04.950 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:04.951 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:05.389 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-16T04:07:05.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-16T04:07:05.391 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2024-09-16T04:07:05.484 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-16T04:07:05.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:05.494 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:05.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-09-16T04:07:05.551 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:05.552 INFO:tasks.ceph:role: osd.10 2024-09-16T04:07:05.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:07:05.552 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:05.612 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:06.070 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-16T04:07:06.072 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-16T04:07:06.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2024-09-16T04:07:06.159 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-09-16T04:07:06.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:06.169 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:06.170 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2024-09-16T04:07:06.222 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:06.223 INFO:tasks.ceph:role: osd.14 2024-09-16T04:07:06.223 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:07:06.223 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:06.285 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:06.286 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:06.779 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-16T04:07:06.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-16T04:07:06.781 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2024-09-16T04:07:06.936 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2024-09-16T04:07:06.946 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:06.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:06.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:07.061 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:07.061+0000 7fab49f057c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T04:07:07.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:07.061+0000 7fab49f057c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T04:07:07.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:07.061+0000 7fab49f057c0 -1 bdev(0x5594c0fe9800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:07.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:07.061+0000 7fab49f057c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T04:07:10.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T04:07:10.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:10.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:10.313+0000 7fbff85db7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-16T04:07:10.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:10.313+0000 7fbff85db7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-16T04:07:10.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:10.313+0000 7fbff85db7c0 -1 bdev(0x55a408c5f800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:10.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:10.313+0000 7fbff85db7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-16T04:07:13.451 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-16T04:07:13.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:13.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:13.589+0000 7f8ab00917c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-09-16T04:07:13.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:13.589+0000 7f8ab00917c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-09-16T04:07:13.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:13.589+0000 7f8ab00917c0 -1 bdev(0x562b6ea21800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:13.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:13.589+0000 7f8ab00917c0 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-09-16T04:07:16.757 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-09-16T04:07:16.813 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:16.899 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:16.897+0000 7f8bbf6e27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2024-09-16T04:07:16.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:16.897+0000 7f8bbf6e27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2024-09-16T04:07:16.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:16.897+0000 7f8bbf6e27c0 -1 bdev(0x56151762f800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:16.900 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-16T04:07:16.897+0000 7f8bbf6e27c0 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2024-09-16T04:07:20.052 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2024-09-16T04:07:20.110 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T04:07:20.125 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:20.125 INFO:tasks.ceph:role: osd.3 2024-09-16T04:07:20.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:07:20.125 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T04:07:20.189 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:20.189 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:20.189 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:20.189 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:20.189 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:20.189 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:20.190 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:20.190 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:20.190 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:20.190 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:20.667 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-16T04:07:20.669 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-16T04:07:20.669 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-16T04:07:20.818 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T04:07:20.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:20.828 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:20.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-16T04:07:20.883 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:20.883 INFO:tasks.ceph:role: osd.7 2024-09-16T04:07:20.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:07:20.883 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:20.946 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:20.947 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:20.947 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:21.383 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-16T04:07:21.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-16T04:07:21.386 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2024-09-16T04:07:21.478 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-16T04:07:21.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:21.488 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:21.489 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-09-16T04:07:21.549 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:21.549 INFO:tasks.ceph:role: osd.11 2024-09-16T04:07:21.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:07:21.549 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T04:07:21.613 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:21.613 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:21.614 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:22.074 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-16T04:07:22.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-16T04:07:22.076 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2024-09-16T04:07:22.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-09-16T04:07:22.184 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:22.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:22.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2024-09-16T04:07:22.240 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-16T04:07:22.241 INFO:tasks.ceph:role: osd.15 2024-09-16T04:07:22.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:07:22.241 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T04:07:22.310 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T04:07:22.806 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-16T04:07:22.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-16T04:07:22.809 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2024-09-16T04:07:22.945 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2024-09-16T04:07:22.955 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T04:07:22.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:07:22.956 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:23.171 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:23.165+0000 7f0b631637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T04:07:23.172 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:23.165+0000 7f0b631637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T04:07:23.172 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:23.165+0000 7f0b631637c0 -1 bdev(0x5598fef6b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:23.173 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:23.165+0000 7f0b631637c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T04:07:26.586 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T04:07:26.600 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:26.683 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:26.677+0000 7f07eae347c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-16T04:07:26.684 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:26.677+0000 7f07eae347c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-16T04:07:26.684 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:26.677+0000 7f07eae347c0 -1 bdev(0x55c1def2b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:26.684 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:26.677+0000 7f07eae347c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-16T04:07:29.826 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-16T04:07:29.882 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:29.965 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:29.961+0000 7fdc5a5a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-09-16T04:07:29.966 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:29.961+0000 7fdc5a5a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-09-16T04:07:29.966 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:29.961+0000 7fdc5a5a37c0 -1 bdev(0x55b53dc05800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:29.966 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:29.961+0000 7fdc5a5a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-09-16T04:07:33.357 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-09-16T04:07:33.413 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:33.495 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:33.489+0000 7fc5fabe07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2024-09-16T04:07:33.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:33.489+0000 7fc5fabe07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2024-09-16T04:07:33.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:33.489+0000 7fc5fabe07c0 -1 bdev(0x55ba930a1800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:33.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-16T04:07:33.489+0000 7fc5fabe07c0 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2024-09-16T04:07:36.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2024-09-16T04:07:36.702 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T04:07:36.702 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:36.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T04:07:36.717 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:36.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T04:07:36.774 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:36.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T04:07:36.833 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:36.833 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-09-16T04:07:36.890 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:36.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2024-09-16T04:07:36.944 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:36.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T04:07:36.959 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:36.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T04:07:37.017 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:37.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-09-16T04:07:37.073 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:37.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2024-09-16T04:07:37.128 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:37.128 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T04:07:37.142 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:37.142 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-16T04:07:37.195 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:37.196 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-09-16T04:07:37.248 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:37.249 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2024-09-16T04:07:37.304 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:37.304 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T04:07:37.319 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:37.319 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T04:07:37.372 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:37.372 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-16T04:07:37.425 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:37.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-09-16T04:07:37.481 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:37.481 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2024-09-16T04:07:37.536 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:37.536 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T04:07:37.581 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T04:07:37.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T04:07:37.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T04:07:37.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T04:07:37.594 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-09-16T04:07:37.594 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDJrudmAcz5OhAALgC/G5m6X0w6c5LTml21bw== 2024-09-16T04:07:37.594 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-09-16T04:07:37.594 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDLrudmsNACDBAAeFnIjAX2Kh5LUZ9xq/MWmA== 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDOrudm+HStKBAA/HDPf202k5+mzoNqVTJN2A== 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.8] 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDRrudm4YETOxAAzjEFBMSqo/d4MRVCL2lxWg== 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.12] 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDVrudmd5OiHxAAF9V7dyp/AJgRu4gR+i69MQ== 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDarudmhul/AxAATmmqgKXO15PWCPVTdntl4g== 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDdrudmZI8iIRAA1PZd7UG8VkX9+Vq7PtrfbQ== 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.9] 2024-09-16T04:07:37.595 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDhrudm5Bf8BBAAeZRIcha5osoe2GDeryNvpQ== 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.13] 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDkrudmg2/oNBAA+r1glo8LZPcU7W2c3iS2Yg== 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrrudm2CS8AxAA2GIB7zKCFRx76rugFVktIg== 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDurudmlBfoEhAAjZs29vMnfVKyQup/E2BZQg== 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.10] 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDxrudmtmhHIxAA1pvGe6c3gMVLjvmQSHtsMw== 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.14] 2024-09-16T04:07:37.596 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD0rudmyN+yNRAAjt2ienENJDihhhthj705nQ== 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDKrudmzVQYAhAARFe0NknpEjyUQhLu5mWPeA== 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD7rudmNas5ChAAmA8KbUfZrpsA8/ysDP2LfA== 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD+rudm5hLGKBAA1EHV3iRZCl+PveCaZiPB9w== 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.11] 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQABr+dmwaaTORAA/R5gFfZNE8ILqBJKzBhrHA== 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.15] 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAFr+dmZ5qVHRAAI9osttZco37eJGn82f5F5g== 2024-09-16T04:07:37.597 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-09-16T04:07:37.598 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDKrudm+KYzBxAApt+OvBAgyTZQGtAnuTy4sQ== 2024-09-16T04:07:37.599 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-09-16T04:07:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDJrudmAcz5OhAALgC/G5m6X0w6c5LTml21bw== 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDLrudmsNACDBAAeFnIjAX2Kh5LUZ9xq/MWmA== 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDOrudm+HStKBAA/HDPf202k5+mzoNqVTJN2A== 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.8] 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDRrudm4YETOxAAzjEFBMSqo/d4MRVCL2lxWg== 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.12] 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDVrudmd5OiHxAAF9V7dyp/AJgRu4gR+i69MQ== 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDarudmhul/AxAATmmqgKXO15PWCPVTdntl4g== 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-09-16T04:07:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDdrudmZI8iIRAA1PZd7UG8VkX9+Vq7PtrfbQ== 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.9] 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDhrudm5Bf8BBAAeZRIcha5osoe2GDeryNvpQ== 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.13] 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDkrudmg2/oNBAA+r1glo8LZPcU7W2c3iS2Yg== 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDrrudm2CS8AxAA2GIB7zKCFRx76rugFVktIg== 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDurudmlBfoEhAAjZs29vMnfVKyQup/E2BZQg== 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.10] 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDxrudmtmhHIxAA1pvGe6c3gMVLjvmQSHtsMw== 2024-09-16T04:07:37.601 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.14] 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD0rudmyN+yNRAAjt2ienENJDihhhthj705nQ== 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDKrudmzVQYAhAARFe0NknpEjyUQhLu5mWPeA== 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD7rudmNas5ChAAmA8KbUfZrpsA8/ysDP2LfA== 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD+rudm5hLGKBAA1EHV3iRZCl+PveCaZiPB9w== 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.11] 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQABr+dmwaaTORAA/R5gFfZNE8ILqBJKzBhrHA== 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.15] 2024-09-16T04:07:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAFr+dmZ5qVHRAAI9osttZco37eJGn82f5F5g== 2024-09-16T04:07:37.603 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-16T04:07:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDKrudm+KYzBxAApt+OvBAgyTZQGtAnuTy4sQ== 2024-09-16T04:07:37.603 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDJrudmAcz5OhAALgC/G5m6X0w6c5LTml21bw== 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDLrudmsNACDBAAeFnIjAX2Kh5LUZ9xq/MWmA== 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDOrudm+HStKBAA/HDPf202k5+mzoNqVTJN2A== 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.8] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDRrudm4YETOxAAzjEFBMSqo/d4MRVCL2lxWg== 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.12] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDVrudmd5OiHxAAF9V7dyp/AJgRu4gR+i69MQ== 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDarudmhul/AxAATmmqgKXO15PWCPVTdntl4g== 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-09-16T04:07:37.604 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDdrudmZI8iIRAA1PZd7UG8VkX9+Vq7PtrfbQ== 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.9] 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDhrudm5Bf8BBAAeZRIcha5osoe2GDeryNvpQ== 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.13] 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDkrudmg2/oNBAA+r1glo8LZPcU7W2c3iS2Yg== 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDrrudm2CS8AxAA2GIB7zKCFRx76rugFVktIg== 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDurudmlBfoEhAAjZs29vMnfVKyQup/E2BZQg== 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.10] 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDxrudmtmhHIxAA1pvGe6c3gMVLjvmQSHtsMw== 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.14] 2024-09-16T04:07:37.605 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQD0rudmyN+yNRAAjt2ienENJDihhhthj705nQ== 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDKrudmzVQYAhAARFe0NknpEjyUQhLu5mWPeA== 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQD7rudmNas5ChAAmA8KbUfZrpsA8/ysDP2LfA== 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQD+rudm5hLGKBAA1EHV3iRZCl+PveCaZiPB9w== 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.11] 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQABr+dmwaaTORAA/R5gFfZNE8ILqBJKzBhrHA== 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.15] 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAFr+dmZ5qVHRAAI9osttZco37eJGn82f5F5g== 2024-09-16T04:07:37.606 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-09-16T04:07:37.607 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDKrudm+KYzBxAApt+OvBAgyTZQGtAnuTy4sQ== 2024-09-16T04:07:37.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T04:07:37.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T04:07:37.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T04:07:37.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.816 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:37.988 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.257 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.267 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.309 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.360 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.547 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.640 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.708 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.734 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T04:07:38.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T04:07:38.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T04:07:38.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.885 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.966 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:38.974 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.051 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T04:07:39.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T04:07:39.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T04:07:39.225 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T04:07:39.273 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T04:07:39.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T04:07:39.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T04:07:39.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T04:07:39.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T04:07:39.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T04:07:39.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T04:07:39.553 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T04:07:39.567 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T04:07:39.661 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T04:07:39.673 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:39.675 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:39.678 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T04:07:39.722 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T04:07:39.722 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T04:07:39.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T04:07:39.725 INFO:tasks.ceph.mon.a:Started 2024-09-16T04:07:39.725 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T04:07:39.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T04:07:39.728 INFO:tasks.ceph.mon.b:Started 2024-09-16T04:07:39.728 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T04:07:39.728 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T04:07:39.766 INFO:tasks.ceph.mon.c:Started 2024-09-16T04:07:39.766 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T04:07:39.766 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T04:07:39.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T04:07:39.769 INFO:tasks.ceph.mgr.y:Started 2024-09-16T04:07:39.769 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T04:07:39.769 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T04:07:39.771 INFO:tasks.ceph.mgr.x:Started 2024-09-16T04:07:39.771 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T04:07:39.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T04:07:45.240 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-09-16T04:07:45.260 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T04:07:45.260 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T04:07:45.260 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:45.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T04:07:45.274 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:45.274 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T04:07:45.328 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:45.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-09-16T04:07:45.384 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-16T04:07:45.384 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2024-09-16T04:07:45.423 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:45.417+0000 7f8a87bab180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T04:07:45.441 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:45.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T04:07:45.457 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:45.457 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T04:07:45.514 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:45.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-09-16T04:07:45.572 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-16T04:07:45.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2024-09-16T04:07:45.573 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:45.572+0000 7ff2627e5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T04:07:45.630 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:45.630 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T04:07:45.644 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:45.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-16T04:07:45.705 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:45.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-09-16T04:07:45.760 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-16T04:07:45.760 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2024-09-16T04:07:45.816 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:45.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T04:07:45.828 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:45.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-16T04:07:45.886 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:45.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-09-16T04:07:45.941 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-16T04:07:45.942 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2024-09-16T04:07:45.946 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:45.941+0000 7f8a87bab180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T04:07:45.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 772dd30d-adce-4356-af08-b3b736f76522 0 2024-09-16T04:07:46.109 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:46.108+0000 7ff2627e5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T04:07:46.151 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:46.145+0000 7f8a87bab180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T04:07:46.210 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-09-16T04:07:46.229 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 4d1f3ec3-2122-4c73-88b8-5592b6018cf6 1 2024-09-16T04:07:46.316 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:46.312+0000 7ff2627e5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T04:07:46.437 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-16T04:07:46.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c43581d9-7f5c-4add-b701-3d4ca819cc21 2 2024-09-16T04:07:46.722 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-09-16T04:07:46.744 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 5f8be370-dca7-4e97-9881-ebe2844d921e 3 2024-09-16T04:07:46.808 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:46.801+0000 7f8a87bab180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T04:07:46.863 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:46.857+0000 7f8a87bab180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T04:07:46.915 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:46.912+0000 7ff2627e5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T04:07:46.917 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:46.913+0000 7f8a87bab180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T04:07:46.953 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-09-16T04:07:46.969 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c379bcc8-87f2-4f46-bec9-0ffba89178d7 4 2024-09-16T04:07:46.972 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:46.968+0000 7ff2627e5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T04:07:46.996 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:46.989+0000 7f8a87bab180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T04:07:47.027 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.024+0000 7ff2627e5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T04:07:47.050 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:47.045+0000 7f8a87bab180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T04:07:47.107 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.104+0000 7ff2627e5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T04:07:47.129 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:47.125+0000 7f8a87bab180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T04:07:47.162 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.160+0000 7ff2627e5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T04:07:47.169 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-09-16T04:07:47.184 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:47.177+0000 7f8a87bab180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T04:07:47.186 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new a973a162-2635-40c6-877d-af5305b3009e 5 2024-09-16T04:07:47.243 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.240+0000 7ff2627e5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T04:07:47.298 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.296+0000 7ff2627e5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T04:07:47.336 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:47.329+0000 7f8a87bab180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T04:07:47.414 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:47.409+0000 7f8a87bab180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T04:07:47.444 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-09-16T04:07:47.457 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.456+0000 7ff2627e5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T04:07:47.460 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 45f16fc0-11df-42cc-be0e-4c5121d77bac 6 2024-09-16T04:07:47.521 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:47.516+0000 7ff2627e5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T04:07:47.654 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-09-16T04:07:47.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 3ae2fec7-73aa-4a64-8e60-2708cf125e1c 7 2024-09-16T04:07:47.905 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-09-16T04:07:47.921 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 66723a2f-fea1-4f58-8a13-4975a1246b3b 8 2024-09-16T04:07:48.009 INFO:tasks.ceph.mgr.x.smithi204.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T04:07:48.010 INFO:tasks.ceph.mgr.x.smithi204.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T04:07:48.010 INFO:tasks.ceph.mgr.x.smithi204.stderr: from numpy import show_config as show_numpy_config 2024-09-16T04:07:48.073 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:48.069+0000 7f8a87bab180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T04:07:48.119 INFO:teuthology.orchestra.run.smithi204.stdout:8 2024-09-16T04:07:48.136 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new c5748e2c-4ba4-4375-9eef-4f94700b757d 9 2024-09-16T04:07:48.191 INFO:tasks.ceph.mgr.y.smithi032.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T04:07:48.191 INFO:tasks.ceph.mgr.y.smithi032.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T04:07:48.191 INFO:tasks.ceph.mgr.y.smithi032.stderr: from numpy import show_config as show_numpy_config 2024-09-16T04:07:48.217 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:48.213+0000 7f8a87bab180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T04:07:48.260 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:48.256+0000 7ff2627e5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T04:07:48.340 INFO:teuthology.orchestra.run.smithi204.stdout:9 2024-09-16T04:07:48.357 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b237a4a6-bd4a-4a81-a614-e4a3630fea08 10 2024-09-16T04:07:48.382 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:48.377+0000 7f8a87bab180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T04:07:48.447 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:48.441+0000 7f8a87bab180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T04:07:48.448 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:48.444+0000 7ff2627e5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T04:07:48.561 INFO:teuthology.orchestra.run.smithi204.stdout:10 2024-09-16T04:07:48.578 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 63044142-acbb-4bdc-a74e-35bc92551e8d 11 2024-09-16T04:07:48.586 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:48.581+0000 7f8a87bab180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T04:07:48.626 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:48.624+0000 7ff2627e5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T04:07:48.703 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:48.700+0000 7ff2627e5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T04:07:48.785 INFO:teuthology.orchestra.run.smithi204.stdout:11 2024-09-16T04:07:48.801 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 1bdce88f-939d-40e3-bee0-9a99c41df477 12 2024-09-16T04:07:48.854 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:48.852+0000 7ff2627e5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T04:07:48.996 INFO:teuthology.orchestra.run.smithi204.stdout:12 2024-09-16T04:07:49.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 88d92110-ec36-4bad-917b-aae13a69c4f8 13 2024-09-16T04:07:49.211 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:49.205+0000 7f8a87bab180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T04:07:49.220 INFO:teuthology.orchestra.run.smithi204.stdout:13 2024-09-16T04:07:49.237 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b8b37904-bb6e-435e-b90c-9a5ebb70e2b6 14 2024-09-16T04:07:49.290 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:49.285+0000 7f8a87bab180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T04:07:49.437 INFO:teuthology.orchestra.run.smithi204.stdout:14 2024-09-16T04:07:49.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 92df4e5f-b365-4c0b-ad9c-8af261cb4cd7 15 2024-09-16T04:07:49.477 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:49.473+0000 7f8a87bab180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T04:07:49.502 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:49.500+0000 7ff2627e5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T04:07:49.552 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:49.545+0000 7f8a87bab180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T04:07:49.581 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:49.580+0000 7ff2627e5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T04:07:49.656 INFO:teuthology.orchestra.run.smithi204.stdout:15 2024-09-16T04:07:49.672 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T04:07:49.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T04:07:49.676 INFO:tasks.ceph.osd.0:Started 2024-09-16T04:07:49.676 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T04:07:49.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T04:07:49.680 INFO:tasks.ceph.osd.4:Started 2024-09-16T04:07:49.680 INFO:tasks.ceph.osd.8:Restarting daemon 2024-09-16T04:07:49.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-09-16T04:07:49.683 INFO:tasks.ceph.osd.8:Started 2024-09-16T04:07:49.683 INFO:tasks.ceph.osd.12:Restarting daemon 2024-09-16T04:07:49.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-09-16T04:07:49.685 INFO:tasks.ceph.osd.12:Started 2024-09-16T04:07:49.685 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T04:07:49.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T04:07:49.688 INFO:tasks.ceph.osd.1:Started 2024-09-16T04:07:49.688 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T04:07:49.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T04:07:49.691 INFO:tasks.ceph.osd.5:Started 2024-09-16T04:07:49.691 INFO:tasks.ceph.osd.9:Restarting daemon 2024-09-16T04:07:49.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-09-16T04:07:49.693 INFO:tasks.ceph.osd.9:Started 2024-09-16T04:07:49.693 INFO:tasks.ceph.osd.13:Restarting daemon 2024-09-16T04:07:49.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2024-09-16T04:07:49.696 INFO:tasks.ceph.osd.13:Started 2024-09-16T04:07:49.696 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T04:07:49.696 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T04:07:49.698 INFO:tasks.ceph.osd.2:Started 2024-09-16T04:07:49.699 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-16T04:07:49.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-16T04:07:49.701 INFO:tasks.ceph.osd.6:Started 2024-09-16T04:07:49.701 INFO:tasks.ceph.osd.10:Restarting daemon 2024-09-16T04:07:49.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-09-16T04:07:49.703 INFO:tasks.ceph.osd.10:Started 2024-09-16T04:07:49.704 INFO:tasks.ceph.osd.14:Restarting daemon 2024-09-16T04:07:49.704 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-09-16T04:07:49.706 INFO:tasks.ceph.osd.14:Started 2024-09-16T04:07:49.706 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T04:07:49.707 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T04:07:49.723 INFO:tasks.ceph.osd.3:Started 2024-09-16T04:07:49.723 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-16T04:07:49.724 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-16T04:07:49.726 INFO:tasks.ceph.osd.7:Started 2024-09-16T04:07:49.726 INFO:tasks.ceph.osd.11:Restarting daemon 2024-09-16T04:07:49.726 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-09-16T04:07:49.728 INFO:tasks.ceph.osd.11:Started 2024-09-16T04:07:49.728 INFO:tasks.ceph.osd.15:Restarting daemon 2024-09-16T04:07:49.728 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2024-09-16T04:07:49.731 INFO:tasks.ceph.osd.15:Started 2024-09-16T04:07:49.731 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:07:49.793 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:49.792+0000 7ff2627e5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T04:07:49.872 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:49.865+0000 7f8a87bab180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T04:07:49.873 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:49.872+0000 7ff2627e5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T04:07:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:07:49.916 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:07:49.653622+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T04:07:49.653622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:07:49.932 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T04:07:49.933 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T04:07:49.933 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:49.929+0000 7f8a87bab180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T04:07:50.182 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:50.180+0000 7ff2627e5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T04:07:50.247 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-16T04:07:50.244+0000 7ff2627e5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T04:07:50.980 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:50.973+0000 7f8a2e7e0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T04:07:50.982 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:07:50.977+0000 7f8a2e7e0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T04:07:51.050 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:07:51.048+0000 7f11b2fb47c0 -1 Falling back to public interface 2024-09-16T04:07:51.070 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:07:51.069+0000 7f48f6b217c0 -1 Falling back to public interface 2024-09-16T04:07:51.097 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:07:51.096+0000 7fdc8f37d7c0 -1 Falling back to public interface 2024-09-16T04:07:51.135 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:07:51.133+0000 7f6f823f27c0 -1 Falling back to public interface 2024-09-16T04:07:51.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:07:51.281+0000 7f0b5c8027c0 -1 Falling back to public interface 2024-09-16T04:07:51.323 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:07:51.321+0000 7f0573bfe7c0 -1 Falling back to public interface 2024-09-16T04:07:51.398 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:07:51.393+0000 7f5266cdf7c0 -1 Falling back to public interface 2024-09-16T04:07:51.438 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:07:51.436+0000 7f684d3237c0 -1 Falling back to public interface 2024-09-16T04:07:51.530 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:07:51.528+0000 7f7e9cecd7c0 -1 Falling back to public interface 2024-09-16T04:07:51.534 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:07:51.533+0000 7f2266bc87c0 -1 Falling back to public interface 2024-09-16T04:07:51.540 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T04:07:51.554 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:07:51.552+0000 7f009302d7c0 -1 Falling back to public interface 2024-09-16T04:07:51.557 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:07:51.556+0000 7f5f2cf297c0 -1 Falling back to public interface 2024-09-16T04:07:51.584 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:07:51.581+0000 7f5c1addf7c0 -1 Falling back to public interface 2024-09-16T04:07:51.626 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:07:51.624+0000 7fa4a86b57c0 -1 Falling back to public interface 2024-09-16T04:07:51.749 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:07:51.748+0000 7f2589a267c0 -1 Falling back to public interface 2024-09-16T04:07:51.762 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:07:51.761+0000 7efd7a8f57c0 -1 Falling back to public interface 2024-09-16T04:07:51.836 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-16T04:07:51.836 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":18,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:07:49.653622+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T04:07:49.653622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:07:51.852 DEBUG:teuthology.misc:0 of 16 OSDs are up 2024-09-16T04:07:55.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:07:55.377+0000 7f0b5c8027c0 -1 osd.2 0 log_to_monitors true 2024-09-16T04:07:55.502 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:07:55.501+0000 7f6f823f27c0 -1 osd.15 0 log_to_monitors true 2024-09-16T04:07:55.535 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:07:55.532+0000 7f11b2fb47c0 -1 osd.0 0 log_to_monitors true 2024-09-16T04:07:55.690 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:07:55.684+0000 7f7e9cecd7c0 -1 osd.8 0 log_to_monitors true 2024-09-16T04:07:55.774 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:07:55.772+0000 7f5f2cf297c0 -1 osd.4 0 log_to_monitors true 2024-09-16T04:07:55.846 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:07:55.845+0000 7f48f6b217c0 -1 osd.10 0 log_to_monitors true 2024-09-16T04:07:55.919 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:07:55.917+0000 7f5266cdf7c0 -1 osd.7 0 log_to_monitors true 2024-09-16T04:07:56.015 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:07:56.012+0000 7fdc8f37d7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T04:07:56.024 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:07:56.025+0000 7efd7a8f57c0 -1 osd.14 0 log_to_monitors true 2024-09-16T04:07:56.047 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:07:56.045+0000 7f2266bc87c0 -1 osd.11 0 log_to_monitors true 2024-09-16T04:07:56.053 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:07:56.053+0000 7f5c1addf7c0 -1 osd.6 0 log_to_monitors true 2024-09-16T04:07:56.144 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:07:56.141+0000 7f0573bfe7c0 -1 osd.3 0 log_to_monitors true 2024-09-16T04:07:56.231 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:07:56.228+0000 7f2589a267c0 -1 osd.12 0 log_to_monitors true 2024-09-16T04:07:56.247 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:07:56.244+0000 7f009302d7c0 -1 osd.13 0 log_to_monitors true 2024-09-16T04:07:56.319 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:07:56.316+0000 7fa4a86b57c0 -1 osd.5 0 log_to_monitors true 2024-09-16T04:07:56.431 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:07:56.428+0000 7f684d3237c0 -1 osd.9 0 log_to_monitors true 2024-09-16T04:07:56.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:07:56.461+0000 7f0b57f88640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T04:07:56.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:07:56.481+0000 7f0b545d7640 -1 osd.2 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:57.458 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:07:57.456+0000 7fdc8ab03640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T04:07:57.458 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:07:57.457+0000 7f5262465640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T04:07:57.458 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:07:57.456+0000 7f6848aa9640 -1 osd.9 0 waiting for initial osdmap 2024-09-16T04:07:57.459 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:07:57.456+0000 7f008e7b3640 -1 osd.13 0 waiting for initial osdmap 2024-09-16T04:07:57.472 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:07:57.473+0000 7f48f22a7640 -1 osd.10 0 waiting for initial osdmap 2024-09-16T04:07:57.473 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:07:57.469+0000 7f2263383640 -1 osd.11 0 waiting for initial osdmap 2024-09-16T04:07:57.489 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:07:57.488+0000 7f68450f8640 -1 osd.9 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:57.490 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:07:57.488+0000 7fdc87152640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:57.490 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:07:57.488+0000 7f008ae02640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:57.497 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:07:57.497+0000 7f525eab4640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:57.497 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:07:57.497+0000 7f48ee8f6640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:57.499 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:07:57.497+0000 7f225e99d640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.057 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:07:58.056+0000 7fa4a3e3b640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T04:07:58.077 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:07:58.076+0000 7fa49c482640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.630 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:07:58.629+0000 7f6f7ebad640 -1 osd.15 0 waiting for initial osdmap 2024-09-16T04:07:58.650 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:07:58.649+0000 7f05703b9640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T04:07:58.654 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:07:58.653+0000 7f6f761bf640 -1 osd.15 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.669 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:07:58.669+0000 7f05679cb640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.705 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:07:58.705+0000 7efd770b0640 -1 osd.14 0 waiting for initial osdmap 2024-09-16T04:07:58.708 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:07:58.705+0000 7f5c16565640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T04:07:58.733 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:07:58.733+0000 7f5c0ebac640 -1 osd.6 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.733 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:07:58.733+0000 7efd6e6c2640 -1 osd.14 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.774 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:07:58.772+0000 7f11af76f640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T04:07:58.801 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:07:58.800+0000 7f11a6d81640 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.877 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:07:58.876+0000 7f5f296e4640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T04:07:58.905 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:07:58.904+0000 7f5f20cf6640 -1 osd.4 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:58.942 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:07:58.940+0000 7f25861e1640 -1 osd.12 0 waiting for initial osdmap 2024-09-16T04:07:58.969 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:07:58.968+0000 7f257d7f3640 -1 osd.12 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:59.036 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:07:59.032+0000 7f7e99688640 -1 osd.8 0 waiting for initial osdmap 2024-09-16T04:07:59.057 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:07:59.056+0000 7f7e90c9a640 -1 osd.8 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T04:07:59.461 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T04:07:59.767 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-16T04:07:59.768 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":23,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:07:59.656211+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:07:49.653622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.064220+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.340791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.357839+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.872343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.459706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.824262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.026860+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.235101+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:07:59.783 DEBUG:teuthology.misc:16 of 16 OSDs are up 2024-09-16T04:07:59.784 INFO:tasks.ceph:Creating RBD pool 2024-09-16T04:07:59.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T04:08:00.673 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'rbd' created 2024-09-16T04:08:00.693 DEBUG:teuthology.orchestra.run.smithi032:> rbd --cluster ceph pool init rbd 2024-09-16T04:08:03.811 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T04:08:03.812 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T04:08:03.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T04:08:03.812 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T04:08:03.812 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T04:08:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:04.205 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"flags":0,"active_gid":4112,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":3436527592},{"type":"v1","addr":"172.21.15.204:6801","nonce":3436527592}]},"active_addr":"172.21.15.204:6801/3436527592","active_change":"2024-09-16T04:07:49.959624+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":1989700455}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":115886504}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2625756770}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":1161615910}]}]} 2024-09-16T04:08:04.211 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T04:08:04.211 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T04:08:04.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:08:04.521 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:04.521 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:08:03.684553+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:07:49.653622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T04:08:00.056722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T04:08:00.124851+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0100002288818359,"score_stable":4.0100002288818359,"optimal_score":0.81000000238418579,"raw_score_acting":3.25,"raw_score_stable":3.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.576665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.064220+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.340791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.158758+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.815914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.357839+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.097826+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.872343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.697742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.459706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.824262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.026860+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.185603+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.235101+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.035135+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.542290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:08:04.541 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T04:08:04.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:08:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:04.854 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:08:03.684553+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:07:49.653622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T04:08:00.056722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T04:08:00.124851+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0100002288818359,"score_stable":4.0100002288818359,"optimal_score":0.81000000238418579,"raw_score_acting":3.25,"raw_score_stable":3.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.576665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.064220+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.340791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.158758+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.815914+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.357839+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.097826+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.872343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.697742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.459706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.824262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.026860+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.185603+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.235101+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.035135+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.542290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:08:04.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T04:08:04.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T04:08:04.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T04:08:04.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T04:08:04.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T04:08:04.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T04:08:04.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T04:08:04.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T04:08:04.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-16T04:08:04.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-16T04:08:04.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-16T04:08:04.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-16T04:08:04.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-16T04:08:04.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-16T04:08:04.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-16T04:08:04.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-16T04:08:05.296 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:05.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T04:08:05.352 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:05.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-16T04:08:05.369 INFO:teuthology.orchestra.run.smithi032.stdout:94489280516 2024-09-16T04:08:05.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T04:08:05.386 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:05.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-16T04:08:05.403 INFO:teuthology.orchestra.run.smithi032.stdout:90194313220 2024-09-16T04:08:05.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T04:08:05.404 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:05.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T04:08:05.406 INFO:teuthology.orchestra.run.smithi032.stdout:94489280516 2024-09-16T04:08:05.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T04:08:05.422 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:05.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-16T04:08:05.424 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:05.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T04:08:05.429 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:05.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-16T04:08:05.443 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:05.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T04:08:05.447 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:05.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-16T04:08:05.457 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:05.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-16T04:08:05.462 INFO:teuthology.orchestra.run.smithi032.stdout:94489280516 2024-09-16T04:08:05.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-16T04:08:05.469 INFO:teuthology.orchestra.run.smithi032.stdout:98784247812 2024-09-16T04:08:05.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T04:08:05.516 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:05.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-16T04:08:06.162 INFO:teuthology.orchestra.run.smithi032.stdout:94489280514 2024-09-16T04:08:06.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280514 for osd.1 2024-09-16T04:08:06.343 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:06.398 INFO:teuthology.orchestra.run.smithi032.stdout:90194313219 2024-09-16T04:08:06.398 INFO:teuthology.orchestra.run.smithi032.stdout:98784247809 2024-09-16T04:08:06.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.14 2024-09-16T04:08:06.401 INFO:teuthology.orchestra.run.smithi032.stdout:94489280514 2024-09-16T04:08:06.412 INFO:teuthology.orchestra.run.smithi032.stdout:94489280515 2024-09-16T04:08:06.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.2 2024-09-16T04:08:06.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247809 for osd.8 2024-09-16T04:08:06.445 INFO:teuthology.orchestra.run.smithi032.stdout:98784247809 2024-09-16T04:08:06.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280514 for osd.13 2024-09-16T04:08:06.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.7 2024-09-16T04:08:06.465 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:06.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247809 for osd.4 2024-09-16T04:08:06.501 INFO:teuthology.orchestra.run.smithi032.stdout:94489280515 2024-09-16T04:08:06.503 INFO:teuthology.orchestra.run.smithi032.stdout:94489280514 2024-09-16T04:08:06.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.12 2024-09-16T04:08:06.513 INFO:teuthology.orchestra.run.smithi032.stdout:94489280515 2024-09-16T04:08:06.526 INFO:teuthology.orchestra.run.smithi032.stdout:98784247810 2024-09-16T04:08:06.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.10 2024-09-16T04:08:06.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280514 for osd.5 2024-09-16T04:08:06.537 INFO:teuthology.orchestra.run.smithi032.stdout:98784247809 2024-09-16T04:08:06.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.11 2024-09-16T04:08:06.557 INFO:teuthology.orchestra.run.smithi032.stdout:98784247809 2024-09-16T04:08:06.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.6 2024-09-16T04:08:06.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247809 for osd.0 2024-09-16T04:08:06.565 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:06.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247811 for osd.3 2024-09-16T04:08:06.584 INFO:teuthology.orchestra.run.smithi032.stdout:94489280515 2024-09-16T04:08:06.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247809 for osd.15 2024-09-16T04:08:06.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.9 2024-09-16T04:08:07.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T04:08:07.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-16T04:08:07.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T04:08:07.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-16T04:08:07.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-16T04:08:07.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T04:08:07.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T04:08:07.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-16T04:08:07.531 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-16T04:08:07.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T04:08:07.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-16T04:08:07.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T04:08:07.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T04:08:07.580 INFO:teuthology.orchestra.run.smithi032.stdout:94489280516 2024-09-16T04:08:07.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T04:08:07.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-16T04:08:07.601 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-16T04:08:07.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.1 2024-09-16T04:08:07.630 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.034 INFO:teuthology.orchestra.run.smithi032.stdout:98784247812 2024-09-16T04:08:08.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247812 for osd.14 2024-09-16T04:08:08.109 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.165 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:08.190 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:08.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247811 for osd.8 2024-09-16T04:08:08.204 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.207 INFO:teuthology.orchestra.run.smithi032.stdout:94489280516 2024-09-16T04:08:08.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.7 2024-09-16T04:08:08.253 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.13 2024-09-16T04:08:08.261 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.397 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:08.425 INFO:teuthology.orchestra.run.smithi032.stdout:90194313220 2024-09-16T04:08:08.444 INFO:teuthology.orchestra.run.smithi032.stdout:94489280516 2024-09-16T04:08:08.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247811 for osd.15 2024-09-16T04:08:08.451 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:08.451 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.469 INFO:teuthology.orchestra.run.smithi032.stdout:98784247812 2024-09-16T04:08:08.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.2 2024-09-16T04:08:08.470 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.476 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:08.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.5 2024-09-16T04:08:08.484 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247812 for osd.12 2024-09-16T04:08:08.501 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.504 INFO:teuthology.orchestra.run.smithi032.stdout:98784247811 2024-09-16T04:08:08.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247811 for osd.4 2024-09-16T04:08:08.508 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.9 2024-09-16T04:08:08.512 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.521 INFO:teuthology.orchestra.run.smithi032.stdout:98784247812 2024-09-16T04:08:08.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247810 got 98784247811 for osd.0 2024-09-16T04:08:08.524 INFO:teuthology.orchestra.run.smithi032.stdout:98784247813 2024-09-16T04:08:08.525 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.533 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:08.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247812 for osd.6 2024-09-16T04:08:08.549 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247812 got 98784247813 for osd.3 2024-09-16T04:08:08.552 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.10 2024-09-16T04:08:08.554 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.561 INFO:teuthology.orchestra.run.smithi032.stdout:94489280517 2024-09-16T04:08:08.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.11 2024-09-16T04:08:08.579 DEBUG:teuthology.parallel:result is None 2024-09-16T04:08:08.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T04:08:08.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:08.921 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-09-16T04:08:07.967674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":459096,"kb_used_data":5272,"kb_used_omap":24,"kb_used_meta":452903,"kb_avail":1509490344,"statfs":{"total":1546188226560,"available":1545718112256,"internally_reserved":0,"allocated":5398528,"data_stored":2788502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":463772751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000711"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.692126+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:03.692126+0000","last_peered":"2024-09-16T04:08:03.692126+0000","last_clean":"2024-09-16T04:08:03.692126+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:03.692126+0000","last_undegraded":"2024-09-16T04:08:03.692126+0000","last_fullsized":"2024-09-16T04:08:03.692126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.691261+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:03.691261+0000","last_peered":"2024-09-16T04:08:03.691261+0000","last_clean":"2024-09-16T04:08:03.691261+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:03.691261+0000","last_undegraded":"2024-09-16T04:08:03.691261+0000","last_fullsized":"2024-09-16T04:08:03.691261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.690441+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:03.690441+0000","last_peered":"2024-09-16T04:08:03.690441+0000","last_clean":"2024-09-16T04:08:03.690441+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:03.690441+0000","last_undegraded":"2024-09-16T04:08:03.690441+0000","last_fullsized":"2024-09-16T04:08:03.690441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.263713+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:04.263713+0000","last_peered":"2024-09-16T04:08:04.263713+0000","last_clean":"2024-09-16T04:08:04.263713+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:04.263713+0000","last_undegraded":"2024-09-16T04:08:04.263713+0000","last_fullsized":"2024-09-16T04:08:04.263713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.696624+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:03.696624+0000","last_peered":"2024-09-16T04:08:03.696624+0000","last_clean":"2024-09-16T04:08:03.696624+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:03.696624+0000","last_undegraded":"2024-09-16T04:08:03.696624+0000","last_fullsized":"2024-09-16T04:08:03.696624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259137+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:04.259137+0000","last_peered":"2024-09-16T04:08:04.259137+0000","last_clean":"2024-09-16T04:08:04.259137+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:04.259137+0000","last_undegraded":"2024-09-16T04:08:04.259137+0000","last_fullsized":"2024-09-16T04:08:04.259137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259701+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:04.259701+0000","last_peered":"2024-09-16T04:08:04.259701+0000","last_clean":"2024-09-16T04:08:04.259701+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:04.259701+0000","last_undegraded":"2024-09-16T04:08:04.259701+0000","last_fullsized":"2024-09-16T04:08:04.259701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.054624+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:04.054624+0000","last_peered":"2024-09-16T04:08:04.054624+0000","last_clean":"2024-09-16T04:08:04.054624+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:04.054624+0000","last_undegraded":"2024-09-16T04:08:04.054624+0000","last_fullsized":"2024-09-16T04:08:04.054624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"27'157","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.442027+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:04.442027+0000","last_peered":"2024-09-16T04:08:04.442027+0000","last_clean":"2024-09-16T04:08:04.442027+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:04.442027+0000","last_undegraded":"2024-09-16T04:08:04.442027+0000","last_fullsized":"2024-09-16T04:08:04.442027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,8,9,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[1,2,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,4,5,6,7,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:08.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:09.214 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:09.225 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-09-16T04:08:07.967674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":459096,"kb_used_data":5272,"kb_used_omap":24,"kb_used_meta":452903,"kb_avail":1509490344,"statfs":{"total":1546188226560,"available":1545718112256,"internally_reserved":0,"allocated":5398528,"data_stored":2788502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":463772751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000711"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.692126+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:03.692126+0000","last_peered":"2024-09-16T04:08:03.692126+0000","last_clean":"2024-09-16T04:08:03.692126+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:03.692126+0000","last_undegraded":"2024-09-16T04:08:03.692126+0000","last_fullsized":"2024-09-16T04:08:03.692126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.691261+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:03.691261+0000","last_peered":"2024-09-16T04:08:03.691261+0000","last_clean":"2024-09-16T04:08:03.691261+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:03.691261+0000","last_undegraded":"2024-09-16T04:08:03.691261+0000","last_fullsized":"2024-09-16T04:08:03.691261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.690441+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:03.690441+0000","last_peered":"2024-09-16T04:08:03.690441+0000","last_clean":"2024-09-16T04:08:03.690441+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:03.690441+0000","last_undegraded":"2024-09-16T04:08:03.690441+0000","last_fullsized":"2024-09-16T04:08:03.690441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.263713+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:04.263713+0000","last_peered":"2024-09-16T04:08:04.263713+0000","last_clean":"2024-09-16T04:08:04.263713+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:04.263713+0000","last_undegraded":"2024-09-16T04:08:04.263713+0000","last_fullsized":"2024-09-16T04:08:04.263713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.696624+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:03.696624+0000","last_peered":"2024-09-16T04:08:03.696624+0000","last_clean":"2024-09-16T04:08:03.696624+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:03.696624+0000","last_undegraded":"2024-09-16T04:08:03.696624+0000","last_fullsized":"2024-09-16T04:08:03.696624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259137+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:04.259137+0000","last_peered":"2024-09-16T04:08:04.259137+0000","last_clean":"2024-09-16T04:08:04.259137+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:04.259137+0000","last_undegraded":"2024-09-16T04:08:04.259137+0000","last_fullsized":"2024-09-16T04:08:04.259137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259701+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:04.259701+0000","last_peered":"2024-09-16T04:08:04.259701+0000","last_clean":"2024-09-16T04:08:04.259701+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:04.259701+0000","last_undegraded":"2024-09-16T04:08:04.259701+0000","last_fullsized":"2024-09-16T04:08:04.259701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.054624+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:04.054624+0000","last_peered":"2024-09-16T04:08:04.054624+0000","last_clean":"2024-09-16T04:08:04.054624+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:04.054624+0000","last_undegraded":"2024-09-16T04:08:04.054624+0000","last_fullsized":"2024-09-16T04:08:04.054624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"27'157","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.442027+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:04.442027+0000","last_peered":"2024-09-16T04:08:04.442027+0000","last_clean":"2024-09-16T04:08:04.442027+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:04.442027+0000","last_undegraded":"2024-09-16T04:08:04.442027+0000","last_fullsized":"2024-09-16T04:08:04.442027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,8,9,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[1,2,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,4,5,6,7,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:09.226 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T04:08:09.226 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T04:08:09.226 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T04:08:09.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T04:08:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:09.542 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T04:08:09.560 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T04:08:09.560 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-16T04:08:09.574 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T04:08:09.575 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'osd_object_clean_region_max_num_intervals': 1000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}} 2024-09-16T04:08:09.575 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-16T04:08:09.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-16T04:08:09.888 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-16T04:08:09.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T04:08:09.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:10.198 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-16T04:08:09.968293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":459096,"kb_used_data":5272,"kb_used_omap":24,"kb_used_meta":452903,"kb_avail":1509490344,"statfs":{"total":1546188226560,"available":1545718112256,"internally_reserved":0,"allocated":5398528,"data_stored":2788502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":463772751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001330"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.692126+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:03.692126+0000","last_peered":"2024-09-16T04:08:03.692126+0000","last_clean":"2024-09-16T04:08:03.692126+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:03.692126+0000","last_undegraded":"2024-09-16T04:08:03.692126+0000","last_fullsized":"2024-09-16T04:08:03.692126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.691261+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:03.691261+0000","last_peered":"2024-09-16T04:08:03.691261+0000","last_clean":"2024-09-16T04:08:03.691261+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:03.691261+0000","last_undegraded":"2024-09-16T04:08:03.691261+0000","last_fullsized":"2024-09-16T04:08:03.691261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.690441+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:03.690441+0000","last_peered":"2024-09-16T04:08:03.690441+0000","last_clean":"2024-09-16T04:08:03.690441+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:03.690441+0000","last_undegraded":"2024-09-16T04:08:03.690441+0000","last_fullsized":"2024-09-16T04:08:03.690441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.263713+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:04.263713+0000","last_peered":"2024-09-16T04:08:04.263713+0000","last_clean":"2024-09-16T04:08:04.263713+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:04.263713+0000","last_undegraded":"2024-09-16T04:08:04.263713+0000","last_fullsized":"2024-09-16T04:08:04.263713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.696624+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:03.696624+0000","last_peered":"2024-09-16T04:08:03.696624+0000","last_clean":"2024-09-16T04:08:03.696624+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:03.696624+0000","last_undegraded":"2024-09-16T04:08:03.696624+0000","last_fullsized":"2024-09-16T04:08:03.696624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259137+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:04.259137+0000","last_peered":"2024-09-16T04:08:04.259137+0000","last_clean":"2024-09-16T04:08:04.259137+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:04.259137+0000","last_undegraded":"2024-09-16T04:08:04.259137+0000","last_fullsized":"2024-09-16T04:08:04.259137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259701+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:04.259701+0000","last_peered":"2024-09-16T04:08:04.259701+0000","last_clean":"2024-09-16T04:08:04.259701+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:04.259701+0000","last_undegraded":"2024-09-16T04:08:04.259701+0000","last_fullsized":"2024-09-16T04:08:04.259701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.054624+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:04.054624+0000","last_peered":"2024-09-16T04:08:04.054624+0000","last_clean":"2024-09-16T04:08:04.054624+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:04.054624+0000","last_undegraded":"2024-09-16T04:08:04.054624+0000","last_fullsized":"2024-09-16T04:08:04.054624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"27'157","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.442027+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:04.442027+0000","last_peered":"2024-09-16T04:08:04.442027+0000","last_clean":"2024-09-16T04:08:04.442027+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:04.442027+0000","last_undegraded":"2024-09-16T04:08:04.442027+0000","last_fullsized":"2024-09-16T04:08:04.442027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,8,9,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[1,2,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280518,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,4,5,6,7,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:10.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:10.485 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:10.503 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-16T04:08:09.968293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":459096,"kb_used_data":5272,"kb_used_omap":24,"kb_used_meta":452903,"kb_avail":1509490344,"statfs":{"total":1546188226560,"available":1545718112256,"internally_reserved":0,"allocated":5398528,"data_stored":2788502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":463772751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001330"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.692126+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:03.692126+0000","last_peered":"2024-09-16T04:08:03.692126+0000","last_clean":"2024-09-16T04:08:03.692126+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:03.692126+0000","last_undegraded":"2024-09-16T04:08:03.692126+0000","last_fullsized":"2024-09-16T04:08:03.692126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.691261+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:03.691261+0000","last_peered":"2024-09-16T04:08:03.691261+0000","last_clean":"2024-09-16T04:08:03.691261+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:03.691261+0000","last_undegraded":"2024-09-16T04:08:03.691261+0000","last_fullsized":"2024-09-16T04:08:03.691261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.690441+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:03.690441+0000","last_peered":"2024-09-16T04:08:03.690441+0000","last_clean":"2024-09-16T04:08:03.690441+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:03.690441+0000","last_undegraded":"2024-09-16T04:08:03.690441+0000","last_fullsized":"2024-09-16T04:08:03.690441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.263713+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:04.263713+0000","last_peered":"2024-09-16T04:08:04.263713+0000","last_clean":"2024-09-16T04:08:04.263713+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:04.263713+0000","last_undegraded":"2024-09-16T04:08:04.263713+0000","last_fullsized":"2024-09-16T04:08:04.263713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:03.696624+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:03.696624+0000","last_peered":"2024-09-16T04:08:03.696624+0000","last_clean":"2024-09-16T04:08:03.696624+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:03.696624+0000","last_undegraded":"2024-09-16T04:08:03.696624+0000","last_fullsized":"2024-09-16T04:08:03.696624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259137+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:04.259137+0000","last_peered":"2024-09-16T04:08:04.259137+0000","last_clean":"2024-09-16T04:08:04.259137+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:04.259137+0000","last_undegraded":"2024-09-16T04:08:04.259137+0000","last_fullsized":"2024-09-16T04:08:04.259137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.259701+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:04.259701+0000","last_peered":"2024-09-16T04:08:04.259701+0000","last_clean":"2024-09-16T04:08:04.259701+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:04.259701+0000","last_undegraded":"2024-09-16T04:08:04.259701+0000","last_fullsized":"2024-09-16T04:08:04.259701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.054624+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:04.054624+0000","last_peered":"2024-09-16T04:08:04.054624+0000","last_clean":"2024-09-16T04:08:04.054624+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:04.054624+0000","last_undegraded":"2024-09-16T04:08:04.054624+0000","last_fullsized":"2024-09-16T04:08:04.054624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"27'157","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T04:08:04.442027+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:04.442027+0000","last_peered":"2024-09-16T04:08:04.442027+0000","last_clean":"2024-09-16T04:08:04.442027+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:04.442027+0000","last_undegraded":"2024-09-16T04:08:04.442027+0000","last_fullsized":"2024-09-16T04:08:04.442027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,8,9,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[1,2,4,5,7,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280518,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,4,5,6,7,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":108182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247811,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":802816,"data_stored":637091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4,5,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":270336,"data_stored":108163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:10.504 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T04:08:10.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-16T04:08:10.800 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 28 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:fsid d778dcff-91d6-4620-92b2-10f7b308093f 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-09-16T04:07:45.122757+0000 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-09-16T04:08:09.823476+0000 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:crush_version 5 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:full_ratio 0.95 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:backfillfull_ratio 0.9 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:nearfull_ratio 0.85 2024-09-16T04:08:10.801 INFO:teuthology.orchestra.run.smithi032.stdout:require_min_compat_client luminous 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:min_compat_client jewel 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:require_osd_release squid 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:stretch_mode_enabled false 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 15.38 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 27 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.01 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:max_osd 16 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/2437639111,v1:172.21.15.32:6801/2437639111] [v2:172.21.15.32:6802/2437639111,v1:172.21.15.32:6803/2437639111] exists,up 772dd30d-adce-4356-af08-b3b736f76522 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6800/3350291568,v1:172.21.15.50:6801/3350291568] [v2:172.21.15.50:6802/3350291568,v1:172.21.15.50:6803/3350291568] exists,up 4d1f3ec3-2122-4c73-88b8-5592b6018cf6 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6808/1937499112,v1:172.21.15.196:6809/1937499112] [v2:172.21.15.196:6810/1937499112,v1:172.21.15.196:6811/1937499112] exists,up c43581d9-7f5c-4add-b701-3d4ca819cc21 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6810/3432709838,v1:172.21.15.204:6811/3432709838] [v2:172.21.15.204:6812/3432709838,v1:172.21.15.204:6813/3432709838] exists,up 5f8be370-dca7-4e97-9881-ebe2844d921e 2024-09-16T04:08:10.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/2357479946,v1:172.21.15.32:6817/2357479946] [v2:172.21.15.32:6818/2357479946,v1:172.21.15.32:6819/2357479946] exists,up c379bcc8-87f2-4f46-bec9-0ffba89178d7 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6824/1697829187,v1:172.21.15.50:6825/1697829187] [v2:172.21.15.50:6826/1697829187,v1:172.21.15.50:6827/1697829187] exists,up a973a162-2635-40c6-877d-af5305b3009e 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6816/2251260649,v1:172.21.15.196:6817/2251260649] [v2:172.21.15.196:6818/2251260649,v1:172.21.15.196:6819/2251260649] exists,up 45f16fc0-11df-42cc-be0e-4c5121d77bac 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6818/713727456,v1:172.21.15.204:6819/713727456] [v2:172.21.15.204:6820/713727456,v1:172.21.15.204:6821/713727456] exists,up 3ae2fec7-73aa-4a64-8e60-2708cf125e1c 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/3629130261,v1:172.21.15.32:6809/3629130261] [v2:172.21.15.32:6810/3629130261,v1:172.21.15.32:6811/3629130261] exists,up 66723a2f-fea1-4f58-8a13-4975a1246b3b 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6808/3996914979,v1:172.21.15.50:6809/3996914979] [v2:172.21.15.50:6810/3996914979,v1:172.21.15.50:6811/3996914979] exists,up c5748e2c-4ba4-4375-9eef-4f94700b757d 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6800/2207776686,v1:172.21.15.196:6801/2207776686] [v2:172.21.15.196:6802/2207776686,v1:172.21.15.196:6803/2207776686] exists,up b237a4a6-bd4a-4a81-a614-e4a3630fea08 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6826/3659784481,v1:172.21.15.204:6827/3659784481] [v2:172.21.15.204:6828/3659784481,v1:172.21.15.204:6829/3659784481] exists,up 63044142-acbb-4bdc-a74e-35bc92551e8d 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/1789797848,v1:172.21.15.32:6825/1789797848] [v2:172.21.15.32:6826/1789797848,v1:172.21.15.32:6827/1789797848] exists,up 1bdce88f-939d-40e3-bee0-9a99c41df477 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6816/1556414646,v1:172.21.15.50:6817/1556414646] [v2:172.21.15.50:6818/1556414646,v1:172.21.15.50:6819/1556414646] exists,up 88d92110-ec36-4bad-917b-aae13a69c4f8 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] [v2:172.21.15.196:6826/3322576165,v1:172.21.15.196:6827/3322576165] exists,up b8b37904-bb6e-435e-b90c-9a5ebb70e2b6 2024-09-16T04:08:10.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] [v2:172.21.15.204:6804/4287478944,v1:172.21.15.204:6805/4287478944] exists,up 92df4e5f-b365-4c0b-ad9c-8af261cb4cd7 2024-09-16T04:08:10.818 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/2437639111,v1:172.21.15.32:6801/2437639111] [v2:172.21.15.32:6802/2437639111,v1:172.21.15.32:6803/2437639111] exists,up 772dd30d-adce-4356-af08-b3b736f76522', 'osd.1 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6800/3350291568,v1:172.21.15.50:6801/3350291568] [v2:172.21.15.50:6802/3350291568,v1:172.21.15.50:6803/3350291568] exists,up 4d1f3ec3-2122-4c73-88b8-5592b6018cf6', 'osd.2 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6808/1937499112,v1:172.21.15.196:6809/1937499112] [v2:172.21.15.196:6810/1937499112,v1:172.21.15.196:6811/1937499112] exists,up c43581d9-7f5c-4add-b701-3d4ca819cc21', 'osd.3 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6810/3432709838,v1:172.21.15.204:6811/3432709838] [v2:172.21.15.204:6812/3432709838,v1:172.21.15.204:6813/3432709838] exists,up 5f8be370-dca7-4e97-9881-ebe2844d921e', 'osd.4 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/2357479946,v1:172.21.15.32:6817/2357479946] [v2:172.21.15.32:6818/2357479946,v1:172.21.15.32:6819/2357479946] exists,up c379bcc8-87f2-4f46-bec9-0ffba89178d7', 'osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6824/1697829187,v1:172.21.15.50:6825/1697829187] [v2:172.21.15.50:6826/1697829187,v1:172.21.15.50:6827/1697829187] exists,up a973a162-2635-40c6-877d-af5305b3009e', 'osd.6 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6816/2251260649,v1:172.21.15.196:6817/2251260649] [v2:172.21.15.196:6818/2251260649,v1:172.21.15.196:6819/2251260649] exists,up 45f16fc0-11df-42cc-be0e-4c5121d77bac', 'osd.7 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6818/713727456,v1:172.21.15.204:6819/713727456] [v2:172.21.15.204:6820/713727456,v1:172.21.15.204:6821/713727456] exists,up 3ae2fec7-73aa-4a64-8e60-2708cf125e1c', 'osd.8 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/3629130261,v1:172.21.15.32:6809/3629130261] [v2:172.21.15.32:6810/3629130261,v1:172.21.15.32:6811/3629130261] exists,up 66723a2f-fea1-4f58-8a13-4975a1246b3b', 'osd.9 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6808/3996914979,v1:172.21.15.50:6809/3996914979] [v2:172.21.15.50:6810/3996914979,v1:172.21.15.50:6811/3996914979] exists,up c5748e2c-4ba4-4375-9eef-4f94700b757d', 'osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6800/2207776686,v1:172.21.15.196:6801/2207776686] [v2:172.21.15.196:6802/2207776686,v1:172.21.15.196:6803/2207776686] exists,up b237a4a6-bd4a-4a81-a614-e4a3630fea08', 'osd.11 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6826/3659784481,v1:172.21.15.204:6827/3659784481] [v2:172.21.15.204:6828/3659784481,v1:172.21.15.204:6829/3659784481] exists,up 63044142-acbb-4bdc-a74e-35bc92551e8d', 'osd.12 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/1789797848,v1:172.21.15.32:6825/1789797848] [v2:172.21.15.32:6826/1789797848,v1:172.21.15.32:6827/1789797848] exists,up 1bdce88f-939d-40e3-bee0-9a99c41df477', 'osd.13 up in weight 1 up_from 22 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6816/1556414646,v1:172.21.15.50:6817/1556414646] [v2:172.21.15.50:6818/1556414646,v1:172.21.15.50:6819/1556414646] exists,up 88d92110-ec36-4bad-917b-aae13a69c4f8', 'osd.14 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] [v2:172.21.15.196:6826/3322576165,v1:172.21.15.196:6827/3322576165] exists,up b8b37904-bb6e-435e-b90c-9a5ebb70e2b6', 'osd.15 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] [v2:172.21.15.204:6804/4287478944,v1:172.21.15.204:6805/4287478944] exists,up 92df4e5f-b365-4c0b-ad9c-8af261cb4cd7'] 2024-09-16T04:08:10.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-16T04:08:10.925 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "name": "mon.a", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster": "ceph", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket_mode": "", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_client_required": "cephx, none", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_cluster_required": "cephx", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_debug": "true", 2024-09-16T04:08:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_required": "cephx", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_supported": "cephx", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio": "true", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_poll_ms": "250", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_reap_max": "16", 2024-09-16T04:08:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_async_discard": "false", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_block_size": "4096", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio": "false", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_inflight_ios": "false", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_enable_discard": "false", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry": "3", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-16T04:08:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash": "0", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring": "false", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_hipri": "false", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-16T04:08:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_type": "", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_alloc_size": "1048576", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_allocator": "hybrid", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_buffered_io": "true", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_for_zeros": "false", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_compact_log_sync": "false", 2024-09-16T04:08:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_log_runway": "4194304", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_prefetch": "1048576", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_flush_size": "524288", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_log_runway": "1048576", 2024-09-16T04:08:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery": "false", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_sync_write": "false", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocation_from_file": "true", 2024-09-16T04:08:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocator": "hybrid", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bdev_label_multi": "true", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-16T04:08:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_create": "true", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_create": "false", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_path": "", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_size": "0", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_path": "", 2024-09-16T04:08:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_preallocate_file": "false", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_size": "107374182400", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_create": "false", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_path": "", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_size": "100663296", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs": "true", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-16T04:08:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune": "true", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-16T04:08:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size": "0", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_type": "2q", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_clone_cow": "true", 2024-09-16T04:08:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_mode": "none", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_csum_type": "crc32c", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-16T04:08:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_freelist": "false", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-16T04:08:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_small_allocations": "0", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_read": "true", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_write": "false", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-16T04:08:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fail_eio": "false", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-16T04:08:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-16T04:08:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_ignore_data_csum": "false", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_op_age": "5.000000", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_alloc_size": "0", 2024-09-16T04:08:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size": "0", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_deferred_txc": "32", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size": "0", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_nid_prealloc": "1024", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-16T04:08:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_retry_disk_reads": "3", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cf": "true", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-16T04:08:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_mem": "512", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_tracing": "false", 2024-09-16T04:08:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_zero_block_detection": "false", 2024-09-16T04:08:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-16T04:08:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_signatures": "false", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_version": "2", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_signatures": "false", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_version": "2", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_signatures": "false", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_version": "2", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_sign_messages": "true", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "chdir": "", 2024-09-16T04:08:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "client_acl_type": "", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_asio_thread_count": "2", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_mid": "0.750000", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_size": "16384", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_caps_release_delay": "5", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_check_pool_perm": "true", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_force_sync_read": "false", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_getattr_caps": "false", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_features": "", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_tick_delay": "0", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-16T04:08:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_remount": "false", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_dirsize_rbytes": "true", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_force_lazyio": "false", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_fs": "", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_release_failure": "false", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_inline_size": "4096", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mds_namespace": "", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_metadata": "", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_gid": "-1", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_timeout": "300", 2024-09-16T04:08:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_uid": "-1", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mountpoint": "/", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_notify_timeout": "10", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc": "true", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty": "104857600", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_objects": "1000", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_size": "209715200", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_target_dirty": "8388608", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_permissions": "true", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota": "true", 2024-09-16T04:08:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota_df": "true", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_bytes": "0", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_periods": "4", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_min": "131072", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_reconnect_stale": "false", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_shutdown_timeout": "30", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_snapdir": ".snap", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_tick_interval": "1", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_trace": "", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_try_dentry_invalidate": "false", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_faked_inos": "false", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_random_mds": "false", 2024-09-16T04:08:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog": "false", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_port": "12201", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_monitors": "default=true", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog": "false", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_level": "info", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "-", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network": "", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network_interface": "", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_isal": "false", 2024-09-16T04:08:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_level": "5", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_winsize": "-15", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zstd_level": "1", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_op_num_threads": "6", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_stat_interval": "0", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_seastar_cpu_cores": "", 2024-09-16T04:08:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_seastar_num_threads": "0", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location": "", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook": "", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook_timeout": "10", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "daemonize": "false", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "daos_pool": "tank", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_alienstore": "0/5", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_allow_any_pool_priority": "false", 2024-09-16T04:08:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok": "1/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok_assert_abort": "false", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asserts_on_shutdown": "true", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_auth": "20/20", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bdev": "1/3", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluefs": "1/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluestore": "1/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_buffer": "0/1", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ceph_exporter": "1/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephfs_mirror": "0/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephsqlite": "0/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_client": "0/5", 2024-09-16T04:08:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_compressor": "1/5", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_context": "0/1", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crimson_interrupt": "0/5", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crush": "1/1", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crypto": "1/5", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cyanstore": "0/5", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_deliberately_leak_memory": "false", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_disable_randomized_ping": "false", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_dpdk": "1/5", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_eventtrace": "1/5", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filer": "0/1", 2024-09-16T04:08:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filestore": "1/3", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_finisher": "1/1", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_fuse": "1/5", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeat_testing_span": "0", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeatmap": "1/5", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_javaclient": "1/5", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journal": "1/3", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journaler": "0/5", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_kstore": "1/5", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_lockdep": "0/1", 2024-09-16T04:08:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mclock": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_balancer": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_locker": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log_expire": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_migrator": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_quiesce": "3/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_memstore": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgr": "2/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgrc": "1/5", 2024-09-16T04:08:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mon": "20/20", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_monc": "0/10", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ms": "1/1", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_none": "0/5", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objclass": "0/5", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objectcacher": "0/5", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objecter": "0/1", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_optracker": "0/5", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_osd": "1/5", 2024-09-16T04:08:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_paxos": "20/20", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_perfcounter": "1/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_prioritycache": "1/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rados": "0/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd": "0/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_mirror": "0/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_pwl": "0/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_replay": "0/5", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_refs": "0/0", 2024-09-16T04:08:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_reserver": "1/1", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_access": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_datacache": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_dbstore": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_flight": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_sync": "1/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rocksdb": "4/5", 2024-09-16T04:08:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore": "0/5", 2024-09-16T04:08:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_backref": "0/5", 2024-09-16T04:08:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cache": "0/5", 2024-09-16T04:08:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cleaner": "0/5", 2024-09-16T04:08:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_device": "0/5", 2024-09-16T04:08:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_epm": "0/5", 2024-09-16T04:08:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_journal": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_lba": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_odata": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_omap": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_onode": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_t": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_tm": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_striper": "0/1", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_test": "0/5", 2024-09-16T04:08:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_throttle": "1/1", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_timer": "0/1", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_tp": "0/5", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_trace": "1/5", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "device_failure_prediction_mode": "none", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_graylog": "false", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_journald": "false", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_stderr": "true", 2024-09-16T04:08:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_syslog": "false", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event_tracing": "false", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_addr": "0.0.0.0", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_http_port": "9926", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_prio_limit": "5", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sort_metrics": "true", 2024-09-16T04:08:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_stats_period": "5", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "fake_statfs_for_testing": "0", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "fatal_signal_handlers": "true", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_purge_ops": "10", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_truncate_ops": "128", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_apply_finisher_threads": "1", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_blackhole": "false", 2024-09-16T04:08:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_clone_range": "true", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_snap": "true", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_caller_concurrency": "10", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_collect_device_partition_information": "true", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_commit_timeout": "600.000000", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_inject_read_err": "false", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_omap_check": "false", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_verify_split": "false", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_dump_file": "", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-16T04:08:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fadvise": "true", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fail_eio": "true", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_shards": "16", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_size": "128", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap": "false", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap_threshold": "4096", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_inject_stall": "0", 2024-09-16T04:08:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_parallel": "false", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_trailing": "false", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_writeahead": "false", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_kill_at": "0", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-16T04:08:10.971 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs": "0", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size": "0", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-16T04:08:10.972 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_merge_threshold": "-10", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_odsync_write": "false", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend": "rocksdb", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend_path": "", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_timeout": "60", 2024-09-16T04:08:10.973 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_threads": "2", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_punch_hole": "false", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-16T04:08:10.974 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_ops": "50", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_seek_data_hole": "false", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc": "false", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_splice": "false", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_multiple": "2", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_rand_factor": "20", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_update_to": "1000", 2024-09-16T04:08:10.975 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_enable": "true", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-16T04:08:10.976 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_xfs_extsize": "false", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_zfs_snap": "false", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fio_dir": "/tmp/fio", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fsid": "d778dcff-91d6-4620-92b2-10f7b308093f", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_allow_other": "true", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_atomic_o_trunc": "true", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_big_writes": "true", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_debug": "false", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_default_permissions": "false", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_disable_pagecache": "false", 2024-09-16T04:08:10.977 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_max_write": "0", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_multithreaded": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_require_active_mds": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_set_user_groups": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_move": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_read": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_write": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_use_invalidate_cb": "true", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_target_name": "ceph", 2024-09-16T04:08:10.978 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_file": "", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_inject_failure": "0", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_interval": "5", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "host": "smithi032", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-16T04:08:10.979 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "inject_early_sigterm": "false", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_agent_port": "6799", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_tracing_enable": "false", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_aio": "true", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_align_min_size": "65536", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_align": "true", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_size": "4096", 2024-09-16T04:08:10.980 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_dio": "true", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_discard": "false", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_force_aio": "false", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_ignore_corruption": "false", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_bytes": "10485760", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_entries": "100", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_replay_from": "0", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_write_header_frequency": "0", 2024-09-16T04:08:10.981 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_zero_on_create": "false", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prefetch_periods": "10", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prezero_periods": "5", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_write_head_interval": "15", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "keyfile": "", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_backend": "rocksdb", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_default_stripe_size": "65536", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount": "false", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_bytes": "67108864", 2024-09-16T04:08:10.982 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_ops": "512", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_nid_prealloc": "1024", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_onode_map_size": "1024", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_submit_transaction": "false", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_transaction": "false", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "librados_thread_count": "2", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep": "false", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep_force_backtrace": "false", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "log_coarse_timestamps": "true", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-16T04:08:10.983 INFO:teuthology.orchestra.run.smithi032.stdout: "log_flush_on_exit": "false", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_host": "127.0.0.1", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_port": "12201", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_new": "1000", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_recent": "10000", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stderr_prefix": "", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stop_at_utilization": "0.970000", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_file": "true", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_graylog": "false", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_journald": "false", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_stderr": "false", 2024-09-16T04:08:10.984 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_syslog": "false", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "max_rotating_auth_attempts": "10", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_action_on_write_error": "1", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_alternate_name_max": "8192", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_asio_thread_count": "2", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_export_pin": "true", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_dirs": "true", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_interval": "5", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-16T04:08:10.985 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_interval": "10", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max": "-1", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max_until": "-1", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_merge_size": "50", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_midchunk": "0.300000", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_start": "0.200000", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_minchunk": "0.001000", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_mode": "0", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_max": "1.200000", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_min": "0.800000", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_overload_epochs": "2", 2024-09-16T04:08:10.986 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_bits": "3", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_size": "10000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_target_decay": "10.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_grace": "15.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_interval": "4.000000", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-16T04:08:10.987 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_mid": "0.700000", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_delay": "0", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_release_free_interval": "10", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_reservation": "0.050000", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_interval": "1", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_threshold": "262144", 2024-09-16T04:08:10.988 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_prealloc_inos": "1000", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_connect_bootstrapping": "false", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_damage_table_max_entries": "10000", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_auth_pins": "false", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_frag": "false", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_scatterstat": "false", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_subtrees": "false", 2024-09-16T04:08:10.989 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_decay_halflife": "5.000000", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_default_dir_hash": "2", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_defer_session_stale": "true", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_deny_all_reconnect": "false", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_keys_per_op": "16384", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_commit_size": "10", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_entries": "0", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_prefetch": "true", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_on_map": "false", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-16T04:08:10.990 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_early_reply": "true", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enable_op_tracker": "true", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enforce_unique_name": "true", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random": "true", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-16T04:08:10.991 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_summarize_threshold": "10", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-16T04:08:10.992 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_health_dummy": "false", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_migrator_session_race": "false", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_join_fs": "", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_journal_format": "1", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_create_at": "0", 2024-09-16T04:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_export_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_import_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_expire_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_replay_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_link_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_mdstable_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_openc_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_rename_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_shutdown_at": "0", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_event_large_threshold": "524288", 2024-09-16T04:08:10.994 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_events_per_segment": "1024", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_events": "-1", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_segments": "128", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_pause": "false", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_segment_size": "0", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_threshold": "128", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-16T04:08:10.995 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_warn_factor": "2.000000", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_caps_per_client": "1048576", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_flushes": "100000", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_requests": "100000", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_export_size": "20971520", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_file_recover": "32", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_files": "64", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops": "8192", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_snaps_per_dir": "100", 2024-09-16T04:08:10.996 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_metrics_update_interval": "2", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_per_client": "100", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_working_set": "10000", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_numa_node": "-1", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_complaint_time": "30.000000", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_duration": "600", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_size": "20", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_size": "20", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_log_threshold": "5", 2024-09-16T04:08:10.997 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_grace": "15", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_interval": "5", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_caps": "30000", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_threshold": "262144", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_interval": "1.000000", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-16T04:08:10.998 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_gid": "0", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_uid": "0", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-16T04:08:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_shutdown_check": "0", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_skip_ino": "0", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_max_uid": "4294967294", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_min_uid": "0", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_rstat": "false", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_standby_replay_damaged": "false", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_symlink_recovery": "true", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_exports": "0", 2024-09-16T04:08:11.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_fragments": "0", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_tick_interval": "5.000000", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_valgrind_exit": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_backtrace": "1", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_scatter": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_sessions": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool_debug": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_device_bytes": "1073741824", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_set": "false", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_size": "65536", 2024-09-16T04:08:11.001 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_bytes": "134217728", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_messages": "512", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_disabled_modules": "", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_enable_op_tracker": "true", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_max_pg_num_change": "128", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_bytes": "134217728", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_messages": "128", 2024-09-16T04:08:11.002 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_bytes": "134217728", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_messages": "128", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_duration": "600", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_size": "20", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_log_threshold": "5", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_bytes": "536870912", 2024-09-16T04:08:11.003 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_messages": "8192", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_pool": "true", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_standby_modules": "true", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_period": "5", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_threshold": "5", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_tick_period": "2", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_delete": "true", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_size_one": "true", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_auth_validate_all_caps": "true", 2024-09-16T04:08:11.004 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_bytes": "104857600", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_directed_command_retry": "5", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_parallel": "3", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_log_interval": "1.000000", 2024-09-16T04:08:11.005 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_interval": "10.000000", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_target_rank": "-1", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file_level": "debug", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_file": "true", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-16T04:08:11.006 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_journald": "false", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_bootstrap": "false", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_start": "false", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_trim": "true", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cpu_threads": "4", 2024-09-16T04:08:11.007 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_crush_min_required_version": "hammer", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_daemon_bytes": "419430400", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_crit": "5", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_warn": "5", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_size_warn": "16106127360", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_json": "false", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_transactions": "false", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_extra_checks": "false", 2024-09-16T04:08:11.008 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_reef": "false", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_squid": "false", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_mkfs_grace": "120", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_uptime_grace": "60", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_default_strategy": "3", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_timeout": "5.000000", 2024-09-16T04:08:11.009 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_divisor": "2", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_enable_op_tracker": "true", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_fake_pool_delete": "false", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_force_quorum_join": "false", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_globalid_prealloc": "10000", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_detail_to_clog": "false", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_log_update_period": "5", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_max_detail": "50", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog": "true", 2024-09-16T04:08:11.010 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_interval": "600", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host": "172.21.15.32,172.21.15.50,172.21.15.196", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host_override": "", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_initial_members": "", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease": "5.000000", 2024-09-16T04:08:11.011 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_full_interval": "50", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max": "10000", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max_summary": "50", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_epochs": "500", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_osd": "10000", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pg_per_osd": "10000", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pool_pg_num": "65536", 2024-09-16T04:08:11.012 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_force_trim_to": "0", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_skip_sanity": "false", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_autotune": "true", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_target": "2147483648", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_beacon_grace": "30", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_digest_period": "5", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_inactive_grace": "60", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-16T04:08:11.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_min_osdmap_epochs": "500", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_complaint_time": "30", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_duration": "600", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_size": "20", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_size": "20", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_log_threshold": "5", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_in": "false", 2024-09-16T04:08:11.014 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size": "500", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_interval": "600", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_force_trim_to": "0", 2024-09-16T04:08:11.015 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_down_reporters": "2", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-16T04:08:11.016 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_report_timeout": "900", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-16T04:08:11.017 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_stuck_threshold": "60", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_probe_timeout": "2.000000", 2024-09-16T04:08:11.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_change": "0.050000", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_osds": "4", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_interval": "300", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_max_keys": "100", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_timeout": "300", 2024-09-16T04:08:11.019 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_session_timeout": "300", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_smart_report_timeout": "5", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stat_smooth_intervals": "6", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_min_size": "2", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_size": "4", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_debug": "false", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-16T04:08:11.020 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_provider_kill_at": "0", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_requester_kill_at": "0", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_timeout": "60.000000", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_target_pg_per_osd": "100", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_tick_interval": "5", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_interval": "300.000000", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_use_min_delay_socket": "false", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_older_version_delay": "604800", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-16T04:08:11.021 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_misplaced": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_older_version": "true", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-16T04:08:11.022 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "monmap": "", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-16T04:08:11.023 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_tracing_enabled": "false", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_op_threads": "3", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_cm": "false", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_device_name": "", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_dscp": "96", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-16T04:08:11.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_local_gid": "", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_port_num": "1", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_sl": "3", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_support_srq": "true", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_type": "ib", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_reap_threshold": "5", 2024-09-16T04:08:11.025 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_before_connect": "false", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv4": "true", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv6": "false", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr1": "true", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr2": "true", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_max": "7568", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_min": "6800", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_count": "3", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_delay": "5", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_client": "false", 2024-09-16T04:08:11.026 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mds": "false", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mgr": "false", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mon": "false", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_osd": "false", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_client_mode": "crc secure", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_mode": "crc secure", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_type": "", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_compress_secure": "false", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_idle_timeout": "900", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_ready_timeout": "10", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_data": "true", 2024-09-16T04:08:11.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_header": "true", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bad_msg": "false", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bug": "true", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_old_message": "true", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_skipped_message": "false", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_coremask": "0xF", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_enable_tso": "true", 2024-09-16T04:08:11.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hugepages": "", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_lro": "true", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_memory_channel": "4", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_pmd": "", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_port_id": "0", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-16T04:08:11.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_on_send": "false", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_initial_backoff": "0.200000", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_max": "1.000000", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_type": "", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_network_congestion": "0", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_socket_failures": "5000", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_learn_addr_from_peer": "true", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_accept_failures": "4", 2024-09-16T04:08:11.030 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_backoff": "15.000000", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_client_mode": "secure crc", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_service_mode": "secure crc", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_min_size": "1024", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_mode": "none", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_min_cost": "65536", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_public_type": "", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_service_mode": "crc secure", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_listen_backlog": "512", 2024-09-16T04:08:11.031 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_nodelay": "true", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_rcvbuf": "0", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_type": "async+posix", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "no_config_file": "false", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_completion_locks_per_session": "32", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_ops": "1024", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-16T04:08:11.032 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_tick_interval": "5.000000", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_timeout": "10.000000", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_blackhole": "false", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "openssl_engine_opts": "", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_delay_time": "5.000000", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_hist_halflife": "1000", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_low_ops": "2", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_ops": "4", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-16T04:08:11.033 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_slop": "0.020000", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_asio_thread_count": "2", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_async_recovery_min_cost": "100", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_max": "512", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_min": "64", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_degraded": "false", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_peering": "false", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_unfound": "true", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_beacon_report_interval": "300", 2024-09-16T04:08:11.034 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_duration": "30", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_max_block_size": "67108864", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blkin_trace_all": "false", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_for_log_corruption": "false", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-16T04:08:11.035 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_update_on_start": "true", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_cap": "256", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_size_cap": "524288000", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_op_priority": "63", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_watch_timeout": "30", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_command_max_records": "256", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_compact_on_start": "false", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-16T04:08:11.036 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_on_start": "true", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_weight_set": "true", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_feed_pullee": "-1", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-16T04:08:11.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_misdirected_ops": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_acting_change": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_purge_strays": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_op_order": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_shutdown": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-16T04:08:11.038 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_trim_objects": "false", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_snaps": "false", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_keys": "1024", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-16T04:08:11.039 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_stride": "524288", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_notify_timeout": "30", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep": "0.000000", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-16T04:08:11.040 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_discard_disconnected_ops": "true", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_enable_op_tracker": "true", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_info": "true", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown": "true", 2024-09-16T04:08:11.041 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_function_tracing": "false", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_grace": "20", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_interval": "6", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_peers": "10", 2024-09-16T04:08:11.042 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_size": "2000", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_stale": "600", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_max_size": "100000", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_min_size": "1000", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_size": "5120", 2024-09-16T04:08:11.043 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_kill_backfill_at": "0", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_cache_size": "50", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_dedup": "true", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max": "40", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_share_max_epochs": "40", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_name_len": "100", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_size": "0", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_backfills": "1", 2024-09-16T04:08:11.044 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_count": "5", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_period": "600", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_name_len": "2048", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_namespace_len": "256", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_size": "134217728", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_blocked_by": "16", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_log_entries": "10000", 2024-09-16T04:08:11.045 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pgls": "1024", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_cost": "8388608", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_objects": "10", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_scrubs": "3", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_trimming_pgs": "2", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_op_reply_len": "64", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_size": "90", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-16T04:08:11.046 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_profile": "balanced", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-16T04:08:11.047 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_base": "805306368", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_min": "134217728", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-16T04:08:11.048 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target": "4294967296", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_autotune": "false", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_pg_log_entries": "250", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_recovery_priority": "0", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_interval": "5", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-16T04:08:11.049 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_cache_shards": "32", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_op_tracker_shard": "32", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_auto_affinity": "true", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_node": "-1", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_prefer_iface": "true", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_object_clean_region_max_num_intervals": "1000", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objecter_finishers": "1", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore": "bluestore", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_fuse": "false", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_tracing": "false", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_complaint_time": "30.000000", 2024-09-16T04:08:11.050 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_duration": "600", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_size": "20", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_size": "20", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_log_threshold": "5", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards": "0", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_hdd": "5", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_ssd": "8", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-16T04:08:11.051 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_min_cost": "65536", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue_cut_off": "high", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_timeout": "15", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_open_classes_on_start": "true", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_os_flags": "0", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_peering_op_priority": "255", 2024-09-16T04:08:11.052 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_cost": "1048576", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_priority": "5", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_max": "10000", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_min": "100", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-16T04:08:11.053 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crimson": "false", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-16T04:08:11.054 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flags": "0", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_min_size": "0", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_num": "32", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pgp_num": "0", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_ratio": "70", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_size": "2", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_type": "replicated", 2024-09-16T04:08:11.055 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_push_per_object_cost": "1000", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap": "true", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_cost": "20971520", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active": "0", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-16T04:08:11.056 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_single_start": "1", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_priority": "3", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_priority": "5", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep": "0.000000", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_repair_during_recovery": "false", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_requested_scrub_priority": "120", 2024-09-16T04:08:11.057 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-16T04:08:11.058 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-16T04:08:11.058 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair": "false", 2024-09-16T04:08:11.058 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_hour": "0", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_week_day": "0", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_max": "25", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_min": "5", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_cost": "52428800", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_during_recovery": "false", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_hour": "0", 2024-09-16T04:08:11.060 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_week_day": "0", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_event_cost": "4096", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_invalid_stats": "true", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_preemptions": "5", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_priority": "5", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_sleep": "0.000000", 2024-09-16T04:08:11.061 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_skip_data_digest": "false", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_smart_report_timeout": "5", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_cost": "1048576", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_priority": "5", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-16T04:08:11.062 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_transaction_size": "30", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-16T04:08:11.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tracing": "false", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_use_stale_snap": "false", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "osdc_blkin_trace_all": "false", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_kill_at": "0", 2024-09-16T04:08:11.064 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_max_join_drift": "10", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min": "500", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min_wait": "0.050000", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_propose_interval": "1.000000", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max": "500", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_min": "250", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_stash_full_interval": "25", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_max": "500", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_min": "250", 2024-09-16T04:08:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "perf": "true", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "-", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrv": "", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "public_bind_addr": "-", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network": "", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network_interface": "", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_busy_polling": "false", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_enabled": "false", 2024-09-16T04:08:11.066 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_session_max_number": "256", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_mon_op_timeout": "0", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_osd_op_timeout": "0", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_tracing": "false", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_atime_update_interval": "60", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_parent_reads": "false", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_snap_reads": "false", 2024-09-16T04:08:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blkin_trace_all": "false", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache": "true", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_policy": "writearound", 2024-09-16T04:08:11.068 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_size": "33554432", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_clone_copy_on_read": "false", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_compression_hint": "none", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_concurrent_management_ops": "10", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_clone_format": "auto", 2024-09-16T04:08:11.069 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_data_pool": "", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_features": "61", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_format": "2", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_map_options": "", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_order": "22", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_pool": "rbd", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_count": "0", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_unit": "0", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-16T04:08:11.070 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_enable_alloc_hint": "true", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler": "simple", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-16T04:08:11.071 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_order": "24", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_pool": "", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_splay_width": "4", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_parent_reads": "false", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_snap_reads": "false", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-16T04:08:11.072 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-16T04:08:11.073 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-16T04:08:11.074 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mtime_update_interval": "60", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_non_blocking_aio": "true", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_thread_timeout": "60", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_threads": "1", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_parent_cache_enabled": "false", 2024-09-16T04:08:11.075 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_plugins": "", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst": "0", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_limit": "0", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_exclude_ops": "0", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst": "0", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-16T04:08:11.076 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_limit": "0", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-16T04:08:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_read_from_replica_policy": "default", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_skip_partial_discard": "true", 2024-09-16T04:08:11.078 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_tracing": "false", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_names": "true", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_pool": "true", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_base_url": "", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_log_level": "", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_acl_grants_max_num": "100", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_admin_entry": "admin", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-16T04:08:11.079 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_backend_store": "rados", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_barbican_url": "", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_beast_enable_async": "true", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_counters_cache": "false", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-16T04:08:11.080 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_enabled": "true", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_expiry_interval": "900", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_lru_size": "25000", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_config_store": "rados", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_content_length_compat": "false", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress": "true", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cors_rules_max_num": "100", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cross_domain_policy": "", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-16T04:08:11.081 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_addr": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_password": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_username": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_require_ssl": "true", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-16T04:08:11.082 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-16T04:08:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_addr": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_auth": "token", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_namespace": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_prefix": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-16T04:08:11.084 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_token_file": "", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_buffersize": "524288", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_time": "300", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-16T04:08:11.085 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_port": "6379", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_changes_size": "1000", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_num_shards": "128", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_window": "30", 2024-09-16T04:08:11.086 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-16T04:08:11.087 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-16T04:08:11.088 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_name": "", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_s3website_name": "", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dynamic_resharding": "true", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_gc_threads": "true", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_lc_threads": "true", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_ops_log": "false", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_quota_threads": "true", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_static_website": "false", 2024-09-16T04:08:11.089 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_usage_log": "false", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enforce_swift_acls": "true", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_exit_timeout_secs": "120", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_expose_bucket": "false", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_extended_http_attrs": "", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_filter": "none", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontends": "beast port=7480", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred": "50", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_objs": "32", 2024-09-16T04:08:11.090 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_period": "3600", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_init_timeout": "300", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-16T04:08:11.091 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_connection_idle": "300", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_domain": "", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password": "", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password_path": "", 2024-09-16T04:08:11.092 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_project": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_tenant": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token_path": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_user": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_api_version": "2", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_domain": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_password": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_project": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_user": "", 2024-09-16T04:08:11.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_url": "", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_debug_interval": "-1", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_lock_max_time": "90", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_objs": "32", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_rules": "1000", 2024-09-16T04:08:11.094 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_worker": "3", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_thread_delay": "0", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_dnattr": "uid", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchfilter": "", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_uri": "", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-16T04:08:11.095 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_http_headers": "", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name_utc": "false", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_name_len": "0", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_size": "0", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_chunk_size": "4194304", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-16T04:08:11.096 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_listing_results": "1000", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_notify_retries": "10", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_param_size": "1048576", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_size": "5368709120", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_slo_entries": "1000", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_log_max_shards": "64", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-16T04:08:11.097 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mp_lock_max_time": "600", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_max_gc": "300", 2024-09-16T04:08:11.098 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_async_rados_threads": "32", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_control_oids": "8", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_numa_node": "-1", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-16T04:08:11.099 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_chunk_size": "100", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_gc_interval": "600", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_timeout": "600", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_tracing": "false", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_token": "", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_url": "", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_verify_ssl": "true", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-16T04:08:11.100 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_rados": "false", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_socket_path": "", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval": "2.000000", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_lanes": "3", 2024-09-16T04:08:11.101 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_partitions": "3", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_continue": "true", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_tracing": "false", 2024-09-16T04:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm": "", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_id": "", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region": "", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_request_uri": "", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_batch_size": "64", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_max_aio": "128", 2024-09-16T04:08:11.103 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_num_logs": "16", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_thread_interval": "600", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_resolve_cname": "false", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_run_sync_thread": "true", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-16T04:08:11.104 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_scheduler_type": "throttler", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_script_uri": "", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_service_provider_name": "", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_id": "", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_secret": "", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_entry": "sts", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_key": "sts", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_min_session_duration": "900", 2024-09-16T04:08:11.105 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_token_introspection_url": "", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_account_in_url": "false", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_entry": "auth", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_url": "", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_custom_header": "", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_need_stats": "true", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_tenant_name": "", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_token_expiration": "86400", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url": "", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url_prefix": "swift", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-16T04:08:11.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_lease_period": "120", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-16T04:08:11.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_thread_pool_size": "512", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_comment": "", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_createby": "", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_encoding": "", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_flag": "false", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_origin": "", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-16T04:08:11.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_tracker": "", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_trust_forwarded_https": "false", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_shards": "32", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_user_shards": "1", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_use_opa_authz": "false", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_counters_cache": "false", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_max_buckets": "1000", 2024-09-16T04:08:11.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_policies_max_num": "100", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_unique_email": "true", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_verify_ssl": "true", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone": "", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_id": "", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup": "", 2024-09-16T04:08:11.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_id": "", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_auto_session_clear": "true", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_block_size": "4096", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_size": "536870912", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-16T04:08:11.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_index_type": "binary_search", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_partition_filters": "false", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_perf": "false", 2024-09-16T04:08:11.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "run_dir": "/var/run/ceph", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_block_create": "true", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cache_lru_size": "67108864", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_max_object_size": "16777216", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_device_size": "53687091200", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-16T04:08:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_full_integrity_check": "false", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_capacity": "16", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_main_device_type": "SSD", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-16T04:08:11.114 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_segment_size": "67108864", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "set_keepcaps": "false", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "setgroup": "", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser": "", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser_match_path": "", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "thp": "false", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_default_timeout": "60", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout: "throttler_perf_counter": "true" 2024-09-16T04:08:11.115 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:11.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-16T04:08:11.262 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-09-16T04:08:11.264 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T04:08:11.275 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-09-16T04:08:11.275 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T04:08:11.290 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-09-16T04:08:11.290 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T04:08:11.306 DEBUG:teuthology.orchestra.run.smithi032:> type ceph-objectstore-tool 2024-09-16T04:08:11.310 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T04:08:11.310 DEBUG:teuthology.orchestra.run.smithi196:> type ceph-objectstore-tool 2024-09-16T04:08:11.316 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T04:08:11.316 DEBUG:teuthology.orchestra.run.smithi050:> type ceph-objectstore-tool 2024-09-16T04:08:11.323 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T04:08:11.323 DEBUG:teuthology.orchestra.run.smithi204:> type ceph-objectstore-tool 2024-09-16T04:08:11.329 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T04:08:11.330 INFO:teuthology.run_tasks:Running task rados... 2024-09-16T04:08:11.341 INFO:tasks.rados:Beginning rados... 2024-09-16T04:08:11.342 DEBUG:teuthology.run_tasks:Unwinding manager rados 2024-09-16T04:08:11.350 INFO:tasks.rados:joining rados 2024-09-16T04:08:11.350 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-16T04:08:11.350 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:08:11.350 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:08:11.351 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-16T04:08:11.351 INFO:tasks.thrashosds.thrasher:Setting osd 15 primary_affinity to 1.000000 2024-09-16T04:08:11.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-09-16T04:08:11.351 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-16T04:08:11.352 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-16T04:08:11.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:11.352 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-16T04:08:11.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:11.353 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-16T04:08:11.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-16T04:08:11.353 INFO:tasks.rados:clients are ['client.0'] 2024-09-16T04:08:11.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set shecprofile c=2 crush-failure-domain=osd k=4 m=3 name=shecprofile plugin=shec 2024-09-16T04:08:11.369 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:11.370+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:11.454 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:11.452+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:11.472 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:11.473 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:11.473 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:11.473 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:11.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:08:11.546 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:11.547 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:11.554 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:11.551+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:11.570 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:11.570 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:11.591 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:11.591 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:11.614 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:11.614 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:11.630 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:11.630 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:11.650 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:11.651 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:11.655 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:11.652+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:11.668 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:11.668 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:11.672 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:11.672 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:11.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:08:11.692 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:11.710 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:11.711 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:11.731 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:11.752 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:11.752 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:11.757 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:11.758+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:11.773 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:11.790 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:11.790 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:11.803 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:11.803 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:11.810 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:11.811 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:11.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:08:11.831 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:11.831 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:11.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:11.827+0000 7f07fad9d640 0 -- 172.21.15.32:0/3914208017 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7f07fc223f50 msgr2=0x7f07fc226340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T04:08:11.857 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:11.856+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:11.876 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-09-16T04:08:11.876 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-16T04:08:11.877 INFO:teuthology.orchestra.run.smithi032.stderr:load: shec 2024-09-16T04:08:11.907 INFO:tasks.rados:starting run 0 out of 1 2024-09-16T04:08:11.907 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-16T04:08:11.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure shecprofile 2024-09-16T04:08:11.952 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:11.952 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:11.958 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:11.955+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:11.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:08:12.060 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:12.058+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:12.063 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:12.063 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:12.126 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.127 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:08:12.160 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:12.158+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:12.248 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.248 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.261 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:12.260+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:12.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:08:12.362 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:12.360+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:12.374 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.374 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:08:12.464 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:12.459+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:12.508 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.508 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:08:12.565 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:12.563+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:12.642 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.643 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:08:12.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:12.663+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:12.766 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:12.766+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:12.822 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.822 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:08:12.868 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:12.863+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:12.958 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:12.958 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:12.969 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:12.966+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:12.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:08:13.070 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:13.070+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:13.097 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:13.097 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:13.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:08:13.170 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:13.167+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:13.246 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:13.246 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:13.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:08:13.308 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:13.306+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:13.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:13.367+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:13.389 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:13.389 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:13.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:08:13.473 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:13.467+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:13.574 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:13.572+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:13.578 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:13.578 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:13.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:08:13.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:13.671+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:13.720 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:13.720 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:13.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:08:13.777 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:13.772+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:13.860 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:13.860 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:13.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:08:13.878 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:13.878+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:13.901 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'unique_pool_0' created 2024-09-16T04:08:13.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-16T04:08:13.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-16T04:08:13.978 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:13.978+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:14.007 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:14.007 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:14.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:08:14.080 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:14.076+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:14.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:14.181 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:14.178+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:14.192 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:14.192 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:14.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:08:14.231 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:14.231 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:14.252 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:14.252 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:14.271 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:14.272 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:14.281 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:14.280+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:14.293 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:14.310 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:14.310 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:14.328 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:14.350 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:14.351 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:14.372 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:14.373 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:14.383 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:14.379+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:14.383 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:14.383 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:14.391 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:14.391 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:14.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:08:14.413 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:14.413 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:14.435 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:14.435 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:14.458 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:14.459 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:14.479 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:14.480 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:14.483 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:14.478+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:14.525 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:14.526 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:14.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:14.526 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [] 2024-09-16T04:08:14.526 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:14.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:08:14.584 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:14.580+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:14.665 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:14.665 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:14.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:08:14.684 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:14.680+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:14.703 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:14.703 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:14.734 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:14.735 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:14.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:14.730+0000 7efd7506b640 0 -- 172.21.15.32:0/2974042668 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7efd702260f0 msgr2=0x7efd702284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:14.785 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:14.778+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:14.806 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:14.807 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:14.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:08:14.886 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:14.883+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-16T04:08:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-16T04:08:14.955 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4347.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:01.768842+0000", 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.187306914000001, 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042617099999999998, 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4347", 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 2 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.768842+0000", 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.768842+0000", 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.768844+0000", 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6630000000000002e-06 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:14.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.768856+0000", 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1758e-05 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.768881+0000", 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4817e-05 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.768900+0000", 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9221000000000001e-05 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769031+0000", 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013107599999999999 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769268+0000", 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000236636 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.960 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4347.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:01.769685+0000", 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.186464131999999, 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031682800000000001, 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4347", 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:14.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769685+0000", 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769685+0000", 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769686+0000", 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.764e-06 2024-09-16T04:08:14.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769696+0000", 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4919999999999999e-06 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769722+0000", 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5758999999999999e-05 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:14.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769735+0000", 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3755e-05 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.769839+0000", 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010418 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:01.770001+0000", 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016187800000000001 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.964 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4347.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:02.680360+0000", 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.275789134, 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003843202, 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4347", 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:08:14.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 5 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680360+0000", 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680360+0000", 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680362+0000", 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.836e-06 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680378+0000", 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5432000000000001e-05 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680411+0000", 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2716000000000003e-05 2024-09-16T04:08:14.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680429+0000", 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7969999999999999e-05 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680547+0000", 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118918 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.680777+0000", 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000229521 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 10", 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.681026+0000", 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000249208 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.682503+0000", 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014769410000000001 2024-09-16T04:08:14.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.684043+0000", 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015402770000000001 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.684121+0000", 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8014000000000002e-05 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.684203+0000", 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1369e-05 2024-09-16T04:08:14.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop_reply(client.4347.0:5 2.2 e25/24 ondisk, result = 0)", 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:02.683841+0000", 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.272307989, 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037752499999999997, 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:14.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.683841+0000", 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.683841+0000", 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:14.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.683843+0000", 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3e-06 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.683857+0000", 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3905e-05 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.683893+0000", 2024-09-16T04:08:14.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5751999999999999e-05 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.683914+0000", 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.126e-05 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.684021+0000", 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107063 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.684035+0000", 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3596e-05 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:02.684218+0000", 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183649 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4347.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:03.693223+0000", 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.262925376, 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034752730000000001, 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4347", 2024-09-16T04:08:14.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693223+0000", 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693223+0000", 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693226+0000", 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.666e-06 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693239+0000", 2024-09-16T04:08:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3212e-05 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693271+0000", 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2095999999999999e-05 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693289+0000", 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7297999999999999e-05 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693408+0000", 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011894499999999999 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693558+0000", 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015002200000000001 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 10", 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.693772+0000", 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021473600000000001 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.695038+0000", 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001265654 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696528+0000", 2024-09-16T04:08:14.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001490075 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696620+0000", 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1638999999999995e-05 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696699+0000", 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8930000000000005e-05 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop_reply(client.4347.0:7 2.2 e26/24 ondisk, result = 0)", 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:03.696352+0000", 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.259796639999999, 2024-09-16T04:08:14.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036055199999999999, 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696352+0000", 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696352+0000", 2024-09-16T04:08:14.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696354+0000", 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9230000000000001e-06 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696364+0000", 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0049e-05 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696390+0000", 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5942999999999999e-05 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696404+0000", 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4199000000000001e-05 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:14.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696505+0000", 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010089 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696519+0000", 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3579e-05 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:03.696713+0000", 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193969 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.987 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:14.988 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:14.989 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:14.990 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:08:14.990 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:14.991 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:14.987+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:15.091 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:15.088+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:15.121 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.122 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:15.122 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:15.122 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:15.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:08:15.193 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:15.194+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:15.259 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.259 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:15.259 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:15.259 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:15.259 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:15.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:08:15.294 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:15.294+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:15.389 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.390 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:15.390 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:15.390 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [] 2024-09-16T04:08:15.390 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:15.395 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:15.390+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:15.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:08:15.496 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:15.492+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:15.529 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.529 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:15.529 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:15.529 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:15.543 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:08:15.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:15.595+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:15.666 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.666 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:15.666 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:15.667 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:15.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:08:15.729 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:15.727+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:15.799 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:15.796+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:15.852 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.852 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:15.852 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:15.852 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [] 2024-09-16T04:08:15.853 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:15.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:08:15.900 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:15.898+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:15.945 DEBUG:teuthology.orchestra.run.smithi204:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight read -> 100 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight delete -> 50 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight snap_create -> 50 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight snap_remove -> 50 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight rollback -> 50 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight setattr -> 25 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight rmattr -> 25 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight copy_from -> 50 2024-09-16T04:08:15.967 INFO:tasks.rados.rados.0.smithi204.stdout:adding op weight append -> 100 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout:ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout:Configuration: 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout: Number of operations: 400 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout: Number of objects: 50 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout: Max in flight operations: 16 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout: Object size (in bytes): 4000000 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout: Write stride min: 400000 2024-09-16T04:08:15.968 INFO:tasks.rados.rados.0.smithi204.stdout: Write stride max: 800000 2024-09-16T04:08:15.988 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:15.988 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:15.988 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:15.988 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:16.000 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:15.995+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:16.002 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:08:16.101 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:16.096+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:16.166 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:16.166 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:16.166 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:16.166 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:16.166 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:16.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:08:16.202 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:16.198+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_repop(client.4347.0:5 2.2 e26/24 2:5cea7035:::rbd_info:head v 26'1, mlcod=0'0)", 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:02.680735+0000", 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 13.618892641, 2024-09-16T04:08:16.299 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0021840679999999999, 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680735+0000", 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.300 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680735+0000", 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680737+0000", 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.356e-06 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680750+0000", 2024-09-16T04:08:16.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3229e-05 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680773+0000", 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3527999999999999e-05 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680798+0000", 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4834999999999999e-05 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.680966+0000", 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000167944 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.681044+0000", 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.7496999999999993e-05 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.682802+0000", 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001757785 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:02.682919+0000", 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011789400000000001 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_repop(client.4347.0:7 2.2 e27/24 2:5cea7035:::rbd_info:head v 27'2, mlcod=0'0)", 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:03.693349+0000", 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 12.606278765999999, 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0021196330000000001, 2024-09-16T04:08:16.304 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693349+0000", 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693349+0000", 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693350+0000", 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693364+0000", 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3939e-05 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693386+0000", 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2342000000000001e-05 2024-09-16T04:08:16.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693409+0000", 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2850999999999999e-05 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693592+0000", 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018277899999999999 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.693645+0000", 2024-09-16T04:08:16.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3390000000000002e-05 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.695319+0000", 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0016736730000000001 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:03.695469+0000", 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000150066 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:16.308 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:16.309 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:16.309 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:16.310 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:16.308+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:16.313 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:08:16.411 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:16.407+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:16.430 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:16.430 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:16.430 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:16.430 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:16.444 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:08:16.512 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:16.508+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:16.597 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:16.597 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:16.597 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:16.597 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:16.597 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:16.609 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:08:16.613 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:16.610+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:16.714 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:16.714+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:16.718 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:16.718 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:16.718 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:16.718 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [] 2024-09-16T04:08:16.718 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:16.730 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:08:16.815 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:16.810+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:16.863 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:16.863 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:16.863 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:16.863 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:16.878 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:08:16.908 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:08:16.909 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:08:16.909 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-16T04:08:16.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-16T04:08:16.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:16.911+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:16.930 INFO:tasks.rados.rados.0.smithi204.stdout:1: write initial oid 1 2024-09-16T04:08:16.930 INFO:tasks.rados.rados.0.smithi204.stdout:1: seq_num 0 ranges {0=32768} 2024-09-16T04:08:16.930 INFO:tasks.rados.rados.0.smithi204.stdout:1: writing smithi20431790-1 from 0 to 32768 tid 1 2024-09-16T04:08:16.930 INFO:tasks.rados.rados.0.smithi204.stdout:2: write initial oid 2 2024-09-16T04:08:16.930 INFO:tasks.rados.rados.0.smithi204.stdout:2: seq_num 1 ranges {0=32768} 2024-09-16T04:08:16.931 INFO:tasks.rados.rados.0.smithi204.stdout:2: writing smithi20431790-2 from 0 to 32768 tid 1 2024-09-16T04:08:16.931 INFO:tasks.rados.rados.0.smithi204.stdout:3: write initial oid 3 2024-09-16T04:08:16.931 INFO:tasks.rados.rados.0.smithi204.stdout:3: seq_num 2 ranges {0=49152} 2024-09-16T04:08:16.931 INFO:tasks.rados.rados.0.smithi204.stdout:3: writing smithi20431790-3 from 0 to 49152 tid 1 2024-09-16T04:08:16.931 INFO:tasks.rados.rados.0.smithi204.stdout:4: write initial oid 4 2024-09-16T04:08:16.931 INFO:tasks.rados.rados.0.smithi204.stdout:4: seq_num 3 ranges {0=65536} 2024-09-16T04:08:16.932 INFO:tasks.rados.rados.0.smithi204.stdout:4: writing smithi20431790-4 from 0 to 65536 tid 1 2024-09-16T04:08:16.932 INFO:tasks.rados.rados.0.smithi204.stdout:5: write initial oid 5 2024-09-16T04:08:16.932 INFO:tasks.rados.rados.0.smithi204.stdout:5: seq_num 4 ranges {0=81920} 2024-09-16T04:08:16.932 INFO:tasks.rados.rados.0.smithi204.stdout:5: writing smithi20431790-5 from 0 to 81920 tid 1 2024-09-16T04:08:16.932 INFO:tasks.rados.rados.0.smithi204.stdout:6: write initial oid 6 2024-09-16T04:08:16.932 INFO:tasks.rados.rados.0.smithi204.stdout:6: seq_num 5 ranges {0=98304} 2024-09-16T04:08:16.935 INFO:tasks.rados.rados.0.smithi204.stdout:6: writing smithi20431790-6 from 0 to 98304 tid 1 2024-09-16T04:08:16.935 INFO:tasks.rados.rados.0.smithi204.stdout:7: write initial oid 7 2024-09-16T04:08:16.935 INFO:tasks.rados.rados.0.smithi204.stdout:7: seq_num 6 ranges {0=114688} 2024-09-16T04:08:16.935 INFO:tasks.rados.rados.0.smithi204.stdout:7: writing smithi20431790-7 from 0 to 114688 tid 1 2024-09-16T04:08:16.935 INFO:tasks.rados.rados.0.smithi204.stdout:8: write initial oid 8 2024-09-16T04:08:16.935 INFO:tasks.rados.rados.0.smithi204.stdout:8: seq_num 7 ranges {0=131072} 2024-09-16T04:08:16.936 INFO:tasks.rados.rados.0.smithi204.stdout:8: writing smithi20431790-8 from 0 to 131072 tid 1 2024-09-16T04:08:16.936 INFO:tasks.rados.rados.0.smithi204.stdout:9: write initial oid 9 2024-09-16T04:08:16.936 INFO:tasks.rados.rados.0.smithi204.stdout:9: seq_num 8 ranges {0=147456} 2024-09-16T04:08:16.938 INFO:tasks.rados.rados.0.smithi204.stdout:9: writing smithi20431790-9 from 0 to 147456 tid 1 2024-09-16T04:08:16.938 INFO:tasks.rados.rados.0.smithi204.stdout:10: write initial oid 10 2024-09-16T04:08:16.939 INFO:tasks.rados.rados.0.smithi204.stdout:10: seq_num 9 ranges {0=163840} 2024-09-16T04:08:16.940 INFO:tasks.rados.rados.0.smithi204.stdout:10: writing smithi20431790-10 from 0 to 163840 tid 1 2024-09-16T04:08:16.940 INFO:tasks.rados.rados.0.smithi204.stdout:11: write initial oid 11 2024-09-16T04:08:16.940 INFO:tasks.rados.rados.0.smithi204.stdout:11: seq_num 10 ranges {0=180224} 2024-09-16T04:08:16.943 INFO:tasks.rados.rados.0.smithi204.stdout:11: writing smithi20431790-11 from 0 to 180224 tid 1 2024-09-16T04:08:16.943 INFO:tasks.rados.rados.0.smithi204.stdout:12: write initial oid 12 2024-09-16T04:08:16.943 INFO:tasks.rados.rados.0.smithi204.stdout:12: seq_num 11 ranges {0=196608} 2024-09-16T04:08:16.945 INFO:tasks.rados.rados.0.smithi204.stdout:12: writing smithi20431790-12 from 0 to 196608 tid 1 2024-09-16T04:08:16.945 INFO:tasks.rados.rados.0.smithi204.stdout:13: write initial oid 13 2024-09-16T04:08:16.945 INFO:tasks.rados.rados.0.smithi204.stdout:13: seq_num 12 ranges {0=212992} 2024-09-16T04:08:16.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-16T04:08:16.947 INFO:tasks.rados.rados.0.smithi204.stdout:13: writing smithi20431790-13 from 0 to 212992 tid 1 2024-09-16T04:08:16.947 INFO:tasks.rados.rados.0.smithi204.stdout:14: write initial oid 14 2024-09-16T04:08:16.947 INFO:tasks.rados.rados.0.smithi204.stdout:14: seq_num 13 ranges {0=229376} 2024-09-16T04:08:16.949 INFO:tasks.rados.rados.0.smithi204.stdout:14: writing smithi20431790-14 from 0 to 229376 tid 1 2024-09-16T04:08:16.949 INFO:tasks.rados.rados.0.smithi204.stdout:15: write initial oid 15 2024-09-16T04:08:16.950 INFO:tasks.rados.rados.0.smithi204.stdout:15: seq_num 14 ranges {0=245760} 2024-09-16T04:08:16.952 INFO:tasks.rados.rados.0.smithi204.stdout:15: writing smithi20431790-15 from 0 to 245760 tid 1 2024-09-16T04:08:16.952 INFO:tasks.rados.rados.0.smithi204.stdout:16: write initial oid 16 2024-09-16T04:08:16.952 INFO:tasks.rados.rados.0.smithi204.stdout:16: seq_num 15 ranges {0=262144} 2024-09-16T04:08:16.955 INFO:tasks.rados.rados.0.smithi204.stdout:16: writing smithi20431790-16 from 0 to 262144 tid 1 2024-09-16T04:08:16.955 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:16.955 INFO:tasks.rados.rados.0.smithi204.stdout:2: finishing write tid 1 to smithi20431790-2 2024-09-16T04:08:16.955 INFO:tasks.rados.rados.0.smithi204.stdout:3: finishing write tid 1 to smithi20431790-3 2024-09-16T04:08:16.956 INFO:tasks.rados.rados.0.smithi204.stdout:3: finishing write tid 2 to smithi20431790-3 2024-09-16T04:08:16.956 INFO:tasks.rados.rados.0.smithi204.stdout:4: finishing write tid 1 to smithi20431790-4 2024-09-16T04:08:16.956 INFO:tasks.rados.rados.0.smithi204.stdout:4: finishing write tid 2 to smithi20431790-4 2024-09-16T04:08:16.956 INFO:tasks.rados.rados.0.smithi204.stdout:6: finishing write tid 1 to smithi20431790-6 2024-09-16T04:08:16.957 INFO:tasks.rados.rados.0.smithi204.stdout:6: finishing write tid 2 to smithi20431790-6 2024-09-16T04:08:16.961 INFO:tasks.rados.rados.0.smithi204.stdout:2: finishing write tid 2 to smithi20431790-2 2024-09-16T04:08:16.961 INFO:tasks.rados.rados.0.smithi204.stdout:5: finishing write tid 1 to smithi20431790-5 2024-09-16T04:08:16.961 INFO:tasks.rados.rados.0.smithi204.stdout:1: finishing write tid 1 to smithi20431790-1 2024-09-16T04:08:16.962 INFO:tasks.rados.rados.0.smithi204.stdout:1: finishing write tid 2 to smithi20431790-1 2024-09-16T04:08:16.962 INFO:tasks.rados.rados.0.smithi204.stdout:7: finishing write tid 1 to smithi20431790-7 2024-09-16T04:08:16.962 INFO:tasks.rados.rados.0.smithi204.stdout:7: finishing write tid 2 to smithi20431790-7 2024-09-16T04:08:16.962 INFO:tasks.rados.rados.0.smithi204.stdout:9: finishing write tid 1 to smithi20431790-9 2024-09-16T04:08:16.962 INFO:tasks.rados.rados.0.smithi204.stdout:9: finishing write tid 2 to smithi20431790-9 2024-09-16T04:08:16.963 INFO:tasks.rados.rados.0.smithi204.stdout:4: finishing write tid 3 to smithi20431790-4 2024-09-16T04:08:16.963 INFO:tasks.rados.rados.0.smithi204.stdout:4: oid 4 updating version 0 to 1 2024-09-16T04:08:16.963 INFO:tasks.rados.rados.0.smithi204.stdout:4: oid 4 updating version 1 to 2 2024-09-16T04:08:16.963 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-16T04:08:16.963 INFO:tasks.rados.rados.0.smithi204.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-09-16T04:08:16.963 INFO:tasks.rados.rados.0.smithi204.stdout:4: done (15 left) 2024-09-16T04:08:16.964 INFO:tasks.rados.rados.0.smithi204.stdout:17: write initial oid 17 2024-09-16T04:08:16.964 INFO:tasks.rados.rados.0.smithi204.stdout:17: seq_num 16 ranges {0=278528} 2024-09-16T04:08:16.967 INFO:tasks.rados.rados.0.smithi204.stdout:17: writing smithi20431790-17 from 0 to 278528 tid 1 2024-09-16T04:08:16.967 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:16.967 INFO:tasks.rados.rados.0.smithi204.stdout:8: finishing write tid 1 to smithi20431790-8 2024-09-16T04:08:16.968 INFO:tasks.rados.rados.0.smithi204.stdout:8: finishing write tid 2 to smithi20431790-8 2024-09-16T04:08:16.968 INFO:tasks.rados.rados.0.smithi204.stdout:5: finishing write tid 2 to smithi20431790-5 2024-09-16T04:08:16.968 INFO:tasks.rados.rados.0.smithi204.stdout:9: finishing write tid 3 to smithi20431790-9 2024-09-16T04:08:16.968 INFO:tasks.rados.rados.0.smithi204.stdout:9: oid 9 updating version 0 to 2 2024-09-16T04:08:16.969 INFO:tasks.rados.rados.0.smithi204.stdout:9: oid 9 version 2 is already newer than 1 2024-09-16T04:08:16.969 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 9 v 2 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-16T04:08:16.969 INFO:tasks.rados.rados.0.smithi204.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:16.969 INFO:tasks.rados.rados.0.smithi204.stdout:11: finishing write tid 1 to smithi20431790-11 2024-09-16T04:08:16.969 INFO:tasks.rados.rados.0.smithi204.stdout:9: done (15 left) 2024-09-16T04:08:16.970 INFO:tasks.rados.rados.0.smithi204.stdout:18: write initial oid 18 2024-09-16T04:08:16.970 INFO:tasks.rados.rados.0.smithi204.stdout:18: seq_num 17 ranges {0=294912} 2024-09-16T04:08:16.970 INFO:tasks.rados.rados.0.smithi204.stdout:18: writing smithi20431790-18 from 0 to 294912 tid 1 2024-09-16T04:08:16.970 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:16.970 INFO:tasks.rados.rados.0.smithi204.stdout:11: finishing write tid 2 to smithi20431790-11 2024-09-16T04:08:16.971 INFO:tasks.rados.rados.0.smithi204.stdout:13: finishing write tid 1 to smithi20431790-13 2024-09-16T04:08:16.971 INFO:tasks.rados.rados.0.smithi204.stdout:13: finishing write tid 2 to smithi20431790-13 2024-09-16T04:08:16.971 INFO:tasks.rados.rados.0.smithi204.stdout:6: finishing write tid 3 to smithi20431790-6 2024-09-16T04:08:16.971 INFO:tasks.rados.rados.0.smithi204.stdout:6: oid 6 updating version 0 to 1 2024-09-16T04:08:16.971 INFO:tasks.rados.rados.0.smithi204.stdout:6: oid 6 updating version 1 to 2 2024-09-16T04:08:16.972 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-16T04:08:16.972 INFO:tasks.rados.rados.0.smithi204.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-09-16T04:08:16.972 INFO:tasks.rados.rados.0.smithi204.stdout:3: finishing write tid 3 to smithi20431790-3 2024-09-16T04:08:16.972 INFO:tasks.rados.rados.0.smithi204.stdout:3: oid 3 updating version 0 to 1 2024-09-16T04:08:16.972 INFO:tasks.rados.rados.0.smithi204.stdout:3: oid 3 updating version 1 to 2 2024-09-16T04:08:16.973 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-09-16T04:08:16.973 INFO:tasks.rados.rados.0.smithi204.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-09-16T04:08:16.973 INFO:tasks.rados.rados.0.smithi204.stdout:3: done (15 left) 2024-09-16T04:08:16.973 INFO:tasks.rados.rados.0.smithi204.stdout:6: done (14 left) 2024-09-16T04:08:16.974 INFO:tasks.rados.rados.0.smithi204.stdout:19: write initial oid 19 2024-09-16T04:08:16.974 INFO:tasks.rados.rados.0.smithi204.stdout:19: seq_num 18 ranges {0=311296} 2024-09-16T04:08:16.978 INFO:tasks.rados.rados.0.smithi204.stdout:19: writing smithi20431790-19 from 0 to 311296 tid 1 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:20: write initial oid 20 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:20: seq_num 19 ranges {0=327680} 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:20: writing smithi20431790-20 from 0 to 327680 tid 1 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:11: finishing write tid 3 to smithi20431790-11 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:11: oid 11 updating version 0 to 1 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:11: oid 11 updating version 1 to 2 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:2: finishing write tid 3 to smithi20431790-2 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:2: oid 2 updating version 0 to 1 2024-09-16T04:08:16.979 INFO:tasks.rados.rados.0.smithi204.stdout:2: oid 2 updating version 1 to 2 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:7: finishing write tid 3 to smithi20431790-7 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:7: oid 7 updating version 0 to 1 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:7: oid 7 updating version 1 to 2 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:13: finishing write tid 3 to smithi20431790-13 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:13: oid 13 updating version 0 to 4 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:13: oid 13 version 4 is already newer than 3 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 13 v 4 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:15: finishing write tid 1 to smithi20431790-15 2024-09-16T04:08:16.980 INFO:tasks.rados.rados.0.smithi204.stdout:15: finishing write tid 2 to smithi20431790-15 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:2: done (15 left) 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:7: done (14 left) 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:11: done (13 left) 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:13: done (12 left) 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:21: write initial oid 21 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:21: seq_num 20 ranges {0=344064} 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:21: writing smithi20431790-21 from 0 to 344064 tid 1 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:22: write initial oid 22 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:22: seq_num 21 ranges {0=360448} 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:22: writing smithi20431790-22 from 0 to 360448 tid 1 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:23: write initial oid 23 2024-09-16T04:08:16.981 INFO:tasks.rados.rados.0.smithi204.stdout:23: seq_num 22 ranges {0=376832} 2024-09-16T04:08:16.982 INFO:tasks.rados.rados.0.smithi204.stdout:23: writing smithi20431790-23 from 0 to 376832 tid 1 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:24: write initial oid 24 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:24: seq_num 23 ranges {0=393216} 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:24: writing smithi20431790-24 from 0 to 393216 tid 1 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:12: finishing write tid 1 to smithi20431790-12 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:15: finishing write tid 3 to smithi20431790-15 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:15: oid 15 updating version 0 to 5 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:15: oid 15 updating version 5 to 6 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 15 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:18: finishing write tid 1 to smithi20431790-18 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:15: done (15 left) 2024-09-16T04:08:16.983 INFO:tasks.rados.rados.0.smithi204.stdout:25: write initial oid 25 2024-09-16T04:08:16.984 INFO:tasks.rados.rados.0.smithi204.stdout:25: seq_num 24 ranges {0=409600} 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:25: writing smithi20431790-25 from 0 to 409600 tid 1 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:14: finishing write tid 1 to smithi20431790-14 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:18: finishing write tid 2 to smithi20431790-18 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:14: finishing write tid 2 to smithi20431790-14 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:5: finishing write tid 3 to smithi20431790-5 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:5: oid 5 updating version 0 to 2 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:5: oid 5 version 2 is already newer than 1 2024-09-16T04:08:16.987 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:18: finishing write tid 3 to smithi20431790-18 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:18: oid 18 updating version 0 to 3 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:18: oid 18 updating version 3 to 4 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 18 v 4 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:1: finishing write tid 3 to smithi20431790-1 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:1: oid 1 updating version 0 to 2 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:1: oid 1 version 2 is already newer than 1 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-09-16T04:08:16.988 INFO:tasks.rados.rados.0.smithi204.stdout:12: finishing write tid 2 to smithi20431790-12 2024-09-16T04:08:16.989 INFO:tasks.rados.rados.0.smithi204.stdout:17: finishing write tid 1 to smithi20431790-17 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:8: finishing write tid 3 to smithi20431790-8 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:8: oid 8 updating version 0 to 3 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:8: oid 8 updating version 3 to 4 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 8 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:19: finishing write tid 1 to smithi20431790-19 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:17: finishing write tid 2 to smithi20431790-17 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:1: done (15 left) 2024-09-16T04:08:16.992 INFO:tasks.rados.rados.0.smithi204.stdout:5: done (14 left) 2024-09-16T04:08:16.993 INFO:tasks.rados.rados.0.smithi204.stdout:8: done (13 left) 2024-09-16T04:08:16.993 INFO:tasks.rados.rados.0.smithi204.stdout:18: done (12 left) 2024-09-16T04:08:16.993 INFO:tasks.rados.rados.0.smithi204.stdout:26: write initial oid 26 2024-09-16T04:08:16.993 INFO:tasks.rados.rados.0.smithi204.stdout:26: seq_num 25 ranges {0=425984} 2024-09-16T04:08:16.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:26: writing smithi20431790-26 from 0 to 425984 tid 1 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:27: write initial oid 27 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:14: finishing write tid 3 to smithi20431790-14 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:14: oid 14 updating version 0 to 4 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:14: oid 14 version 4 is already newer than 3 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 14 v 4 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:10: finishing write tid 1 to smithi20431790-10 2024-09-16T04:08:16.995 INFO:tasks.rados.rados.0.smithi204.stdout:27: seq_num 26 ranges {0=442368} 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:27: writing smithi20431790-27 from 0 to 442368 tid 1 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:14: done (13 left) 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:28: write initial oid 28 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:28: seq_num 27 ranges {0=458752} 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:28: writing smithi20431790-28 from 0 to 458752 tid 1 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:29: write initial oid 29 2024-09-16T04:08:16.996 INFO:tasks.rados.rados.0.smithi204.stdout:29: seq_num 28 ranges {0=475136} 2024-09-16T04:08:16.999 INFO:tasks.rados.rados.0.smithi204.stdout:29: writing smithi20431790-29 from 0 to 475136 tid 1 2024-09-16T04:08:16.999 INFO:tasks.rados.rados.0.smithi204.stdout:30: write initial oid 30 2024-09-16T04:08:17.000 INFO:tasks.rados.rados.0.smithi204.stdout:30: seq_num 29 ranges {0=491520} 2024-09-16T04:08:17.003 INFO:tasks.rados.rados.0.smithi204.stdout:30: writing smithi20431790-30 from 0 to 491520 tid 1 2024-09-16T04:08:17.003 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.003 INFO:tasks.rados.rados.0.smithi204.stdout:10: finishing write tid 2 to smithi20431790-10 2024-09-16T04:08:17.004 INFO:tasks.rados.rados.0.smithi204.stdout:17: finishing write tid 3 to smithi20431790-17 2024-09-16T04:08:17.004 INFO:tasks.rados.rados.0.smithi204.stdout:17: oid 17 updating version 0 to 1 2024-09-16T04:08:17.004 INFO:tasks.rados.rados.0.smithi204.stdout:17: oid 17 updating version 1 to 2 2024-09-16T04:08:17.004 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 17 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-16T04:08:17.005 INFO:tasks.rados.rados.0.smithi204.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-09-16T04:08:17.005 INFO:tasks.rados.rados.0.smithi204.stdout:21: finishing write tid 1 to smithi20431790-21 2024-09-16T04:08:17.005 INFO:tasks.rados.rados.0.smithi204.stdout:21: finishing write tid 2 to smithi20431790-21 2024-09-16T04:08:17.005 INFO:tasks.rados.rados.0.smithi204.stdout:17: done (15 left) 2024-09-16T04:08:17.006 INFO:tasks.rados.rados.0.smithi204.stdout:31: write initial oid 31 2024-09-16T04:08:17.006 INFO:tasks.rados.rados.0.smithi204.stdout:31: seq_num 30 ranges {0=507904} 2024-09-16T04:08:17.008 INFO:tasks.rados.rados.0.smithi204.stdout:31: writing smithi20431790-31 from 0 to 507904 tid 1 2024-09-16T04:08:17.008 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.008 INFO:tasks.rados.rados.0.smithi204.stdout:10: finishing write tid 3 to smithi20431790-10 2024-09-16T04:08:17.008 INFO:tasks.rados.rados.0.smithi204.stdout:10: oid 10 updating version 0 to 5 2024-09-16T04:08:17.008 INFO:tasks.rados.rados.0.smithi204.stdout:10: oid 10 updating version 5 to 6 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 10 v 6 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:16: finishing write tid 1 to smithi20431790-16 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:19: finishing write tid 2 to smithi20431790-19 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:21: finishing write tid 3 to smithi20431790-21 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:21: oid 21 updating version 0 to 5 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:21: oid 21 updating version 5 to 6 2024-09-16T04:08:17.009 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-16T04:08:17.010 INFO:tasks.rados.rados.0.smithi204.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-09-16T04:08:17.010 INFO:tasks.rados.rados.0.smithi204.stdout:16: finishing write tid 2 to smithi20431790-16 2024-09-16T04:08:17.010 INFO:tasks.rados.rados.0.smithi204.stdout:10: done (15 left) 2024-09-16T04:08:17.010 INFO:tasks.rados.rados.0.smithi204.stdout:21: done (14 left) 2024-09-16T04:08:17.010 INFO:tasks.rados.rados.0.smithi204.stdout:32: write initial oid 32 2024-09-16T04:08:17.010 INFO:tasks.rados.rados.0.smithi204.stdout:32: seq_num 31 ranges {0=524288} 2024-09-16T04:08:17.012 INFO:tasks.rados.rados.0.smithi204.stdout:32: writing smithi20431790-32 from 0 to 524288 tid 1 2024-09-16T04:08:17.012 INFO:tasks.rados.rados.0.smithi204.stdout:33: write initial oid 33 2024-09-16T04:08:17.012 INFO:tasks.rados.rados.0.smithi204.stdout:33: seq_num 32 ranges {0=540672} 2024-09-16T04:08:17.017 INFO:tasks.rados.rados.0.smithi204.stdout:33: writing smithi20431790-33 from 0 to 540672 tid 1 2024-09-16T04:08:17.017 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.017 INFO:tasks.rados.rados.0.smithi204.stdout:12: finishing write tid 3 to smithi20431790-12 2024-09-16T04:08:17.017 INFO:tasks.rados.rados.0.smithi204.stdout:12: oid 12 updating version 0 to 2 2024-09-16T04:08:17.017 INFO:tasks.rados.rados.0.smithi204.stdout:12: oid 12 version 2 is already newer than 1 2024-09-16T04:08:17.017 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 12 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:16: finishing write tid 3 to smithi20431790-16 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:16: oid 16 updating version 0 to 8 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:16: oid 16 version 8 is already newer than 7 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 16 v 8 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:08:17.018 INFO:tasks.rados.rados.0.smithi204.stdout:19: finishing write tid 3 to smithi20431790-19 2024-09-16T04:08:17.019 INFO:tasks.rados.rados.0.smithi204.stdout:19: oid 19 updating version 0 to 5 2024-09-16T04:08:17.019 INFO:tasks.rados.rados.0.smithi204.stdout:19: oid 19 updating version 5 to 6 2024-09-16T04:08:17.019 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 19 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-09-16T04:08:17.019 INFO:tasks.rados.rados.0.smithi204.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-09-16T04:08:17.019 INFO:tasks.rados.rados.0.smithi204.stdout:20: finishing write tid 1 to smithi20431790-20 2024-09-16T04:08:17.019 INFO:tasks.rados.rados.0.smithi204.stdout:20: finishing write tid 2 to smithi20431790-20 2024-09-16T04:08:17.020 INFO:tasks.rados.rados.0.smithi204.stdout:23: finishing write tid 1 to smithi20431790-23 2024-09-16T04:08:17.020 INFO:tasks.rados.rados.0.smithi204.stdout:23: finishing write tid 2 to smithi20431790-23 2024-09-16T04:08:17.020 INFO:tasks.rados.rados.0.smithi204.stdout:22: finishing write tid 1 to smithi20431790-22 2024-09-16T04:08:17.020 INFO:tasks.rados.rados.0.smithi204.stdout:25: finishing write tid 1 to smithi20431790-25 2024-09-16T04:08:17.020 INFO:tasks.rados.rados.0.smithi204.stdout:25: finishing write tid 2 to smithi20431790-25 2024-09-16T04:08:17.020 INFO:tasks.rados.rados.0.smithi204.stdout:22: finishing write tid 2 to smithi20431790-22 2024-09-16T04:08:17.021 INFO:tasks.rados.rados.0.smithi204.stdout:24: finishing write tid 1 to smithi20431790-24 2024-09-16T04:08:17.021 INFO:tasks.rados.rados.0.smithi204.stdout:26: finishing write tid 1 to smithi20431790-26 2024-09-16T04:08:17.021 INFO:tasks.rados.rados.0.smithi204.stdout:26: finishing write tid 2 to smithi20431790-26 2024-09-16T04:08:17.021 INFO:tasks.rados.rados.0.smithi204.stdout:20: finishing write tid 3 to smithi20431790-20 2024-09-16T04:08:17.021 INFO:tasks.rados.rados.0.smithi204.stdout:20: oid 20 updating version 0 to 3 2024-09-16T04:08:17.021 INFO:tasks.rados.rados.0.smithi204.stdout:20: oid 20 updating version 3 to 4 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 20 v 4 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:28: finishing write tid 1 to smithi20431790-28 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:28: finishing write tid 2 to smithi20431790-28 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:29: finishing write tid 1 to smithi20431790-29 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:29: finishing write tid 2 to smithi20431790-29 2024-09-16T04:08:17.022 INFO:tasks.rados.rados.0.smithi204.stdout:23: finishing write tid 3 to smithi20431790-23 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:23: oid 23 updating version 0 to 1 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:23: oid 23 updating version 1 to 2 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 23 v 2 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:25: finishing write tid 3 to smithi20431790-25 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:25: oid 25 updating version 0 to 4 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:25: oid 25 version 4 is already newer than 3 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 25 v 4 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-16T04:08:17.023 INFO:tasks.rados.rados.0.smithi204.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:26: finishing write tid 3 to smithi20431790-26 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:26: oid 26 updating version 0 to 1 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:26: oid 26 updating version 1 to 2 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 26 v 2 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:24: finishing write tid 2 to smithi20431790-24 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:28: finishing write tid 3 to smithi20431790-28 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:28: oid 28 updating version 0 to 7 2024-09-16T04:08:17.024 INFO:tasks.rados.rados.0.smithi204.stdout:28: oid 28 updating version 7 to 8 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 28 v 8 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:30: finishing write tid 1 to smithi20431790-30 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:22: finishing write tid 3 to smithi20431790-22 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:22: oid 22 updating version 0 to 5 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:22: oid 22 updating version 5 to 6 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:12: done (15 left) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:16: done (14 left) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:19: done (13 left) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:20: done (12 left) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:22: done (11 left) 2024-09-16T04:08:17.025 INFO:tasks.rados.rados.0.smithi204.stdout:23: done (10 left) 2024-09-16T04:08:17.026 INFO:tasks.rados.rados.0.smithi204.stdout:25: done (9 left) 2024-09-16T04:08:17.026 INFO:tasks.rados.rados.0.smithi204.stdout:26: done (8 left) 2024-09-16T04:08:17.026 INFO:tasks.rados.rados.0.smithi204.stdout:28: done (7 left) 2024-09-16T04:08:17.026 INFO:tasks.rados.rados.0.smithi204.stdout:34: write initial oid 34 2024-09-16T04:08:17.026 INFO:tasks.rados.rados.0.smithi204.stdout:34: seq_num 33 ranges {0=557056} 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:34: writing smithi20431790-34 from 0 to 557056 tid 1 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:35: write initial oid 35 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:35: seq_num 34 ranges {0=573440} 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:35: writing smithi20431790-35 from 0 to 573440 tid 1 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:36: write initial oid 36 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:36: seq_num 35 ranges {0=589824} 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:36: writing smithi20431790-36 from 0 to 589824 tid 1 2024-09-16T04:08:17.028 INFO:tasks.rados.rados.0.smithi204.stdout:37: write initial oid 37 2024-09-16T04:08:17.029 INFO:tasks.rados.rados.0.smithi204.stdout:37: seq_num 36 ranges {0=606208} 2024-09-16T04:08:17.030 INFO:tasks.rados.rados.0.smithi204.stdout:37: writing smithi20431790-37 from 0 to 606208 tid 1 2024-09-16T04:08:17.030 INFO:tasks.rados.rados.0.smithi204.stdout:38: write initial oid 38 2024-09-16T04:08:17.030 INFO:tasks.rados.rados.0.smithi204.stdout:38: seq_num 37 ranges {0=622592} 2024-09-16T04:08:17.033 INFO:tasks.rados.rados.0.smithi204.stdout:38: writing smithi20431790-38 from 0 to 622592 tid 1 2024-09-16T04:08:17.033 INFO:tasks.rados.rados.0.smithi204.stdout:39: write initial oid 39 2024-09-16T04:08:17.033 INFO:tasks.rados.rados.0.smithi204.stdout:39: seq_num 38 ranges {0=638976} 2024-09-16T04:08:17.034 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:17.034 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:17.034 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:17.034 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:17.034 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:17.037 INFO:tasks.rados.rados.0.smithi204.stdout:39: writing smithi20431790-39 from 0 to 638976 tid 1 2024-09-16T04:08:17.037 INFO:tasks.rados.rados.0.smithi204.stdout:40: write initial oid 40 2024-09-16T04:08:17.037 INFO:tasks.rados.rados.0.smithi204.stdout:40: seq_num 39 ranges {0=671744} 2024-09-16T04:08:17.041 INFO:tasks.rados.rados.0.smithi204.stdout:40: writing smithi20431790-40 from 0 to 671744 tid 1 2024-09-16T04:08:17.041 INFO:tasks.rados.rados.0.smithi204.stdout:41: write initial oid 41 2024-09-16T04:08:17.041 INFO:tasks.rados.rados.0.smithi204.stdout:41: seq_num 40 ranges {0=688128} 2024-09-16T04:08:17.045 INFO:tasks.rados.rados.0.smithi204.stdout:41: writing smithi20431790-41 from 0 to 688128 tid 1 2024-09-16T04:08:17.045 INFO:tasks.rados.rados.0.smithi204.stdout:42: write initial oid 42 2024-09-16T04:08:17.045 INFO:tasks.rados.rados.0.smithi204.stdout:42: seq_num 41 ranges {0=704512} 2024-09-16T04:08:17.050 INFO:tasks.rados.rados.0.smithi204.stdout:42: writing smithi20431790-42 from 0 to 704512 tid 1 2024-09-16T04:08:17.050 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.050 INFO:tasks.rados.rados.0.smithi204.stdout:27: finishing write tid 1 to smithi20431790-27 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:24: finishing write tid 3 to smithi20431790-24 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:24: oid 24 updating version 0 to 4 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:24: oid 24 version 4 is already newer than 3 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 24 v 4 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:30: finishing write tid 2 to smithi20431790-30 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:27: finishing write tid 2 to smithi20431790-27 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:24: done (15 left) 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:43: write initial oid 43 2024-09-16T04:08:17.051 INFO:tasks.rados.rados.0.smithi204.stdout:43: seq_num 42 ranges {0=720896} 2024-09-16T04:08:17.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:08:17.055 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:17.050+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout:43: writing smithi20431790-43 from 0 to 720896 tid 1 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout:29: finishing write tid 3 to smithi20431790-29 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout:29: oid 29 updating version 0 to 7 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout:29: oid 29 updating version 7 to 8 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 29 v 8 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-16T04:08:17.056 INFO:tasks.rados.rados.0.smithi204.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:32: finishing write tid 1 to smithi20431790-32 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:32: finishing write tid 2 to smithi20431790-32 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:30: finishing write tid 3 to smithi20431790-30 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:30: oid 30 updating version 0 to 9 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:30: oid 30 updating version 9 to 10 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 10 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:27: finishing write tid 3 to smithi20431790-27 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:27: oid 27 updating version 0 to 4 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:27: oid 27 version 4 is already newer than 3 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 27 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:33: finishing write tid 1 to smithi20431790-33 2024-09-16T04:08:17.057 INFO:tasks.rados.rados.0.smithi204.stdout:27: done (15 left) 2024-09-16T04:08:17.058 INFO:tasks.rados.rados.0.smithi204.stdout:29: done (14 left) 2024-09-16T04:08:17.058 INFO:tasks.rados.rados.0.smithi204.stdout:30: done (13 left) 2024-09-16T04:08:17.058 INFO:tasks.rados.rados.0.smithi204.stdout:44: write initial oid 44 2024-09-16T04:08:17.058 INFO:tasks.rados.rados.0.smithi204.stdout:44: seq_num 43 ranges {0=737280} 2024-09-16T04:08:17.060 INFO:tasks.rados.rados.0.smithi204.stdout:44: writing smithi20431790-44 from 0 to 737280 tid 1 2024-09-16T04:08:17.060 INFO:tasks.rados.rados.0.smithi204.stdout:45: write initial oid 45 2024-09-16T04:08:17.060 INFO:tasks.rados.rados.0.smithi204.stdout:45: seq_num 44 ranges {0=753664} 2024-09-16T04:08:17.065 INFO:tasks.rados.rados.0.smithi204.stdout:45: writing smithi20431790-45 from 0 to 753664 tid 1 2024-09-16T04:08:17.065 INFO:tasks.rados.rados.0.smithi204.stdout:46: write initial oid 46 2024-09-16T04:08:17.065 INFO:tasks.rados.rados.0.smithi204.stdout:46: seq_num 45 ranges {0=770048} 2024-09-16T04:08:17.070 INFO:tasks.rados.rados.0.smithi204.stdout:46: writing smithi20431790-46 from 0 to 770048 tid 1 2024-09-16T04:08:17.070 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.070 INFO:tasks.rados.rados.0.smithi204.stdout:32: finishing write tid 3 to smithi20431790-32 2024-09-16T04:08:17.070 INFO:tasks.rados.rados.0.smithi204.stdout:32: oid 32 updating version 0 to 4 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:32: oid 32 version 4 is already newer than 3 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 32 v 4 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:33: finishing write tid 2 to smithi20431790-33 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:31: finishing write tid 1 to smithi20431790-31 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:33: finishing write tid 3 to smithi20431790-33 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:33: oid 33 updating version 0 to 2 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:33: oid 33 version 2 is already newer than 1 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 33 v 2 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:31: finishing write tid 2 to smithi20431790-31 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:34: finishing write tid 1 to smithi20431790-34 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:31: finishing write tid 3 to smithi20431790-31 2024-09-16T04:08:17.071 INFO:tasks.rados.rados.0.smithi204.stdout:31: oid 31 updating version 0 to 11 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:31: oid 31 updating version 11 to 12 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 31 v 12 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:34: finishing write tid 2 to smithi20431790-34 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:31: done (15 left) 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:32: done (14 left) 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:33: done (13 left) 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:47: write initial oid 47 2024-09-16T04:08:17.072 INFO:tasks.rados.rados.0.smithi204.stdout:47: seq_num 46 ranges {0=786432} 2024-09-16T04:08:17.074 INFO:tasks.rados.rados.0.smithi204.stdout:47: writing smithi20431790-47 from 0 to 786432 tid 1 2024-09-16T04:08:17.074 INFO:tasks.rados.rados.0.smithi204.stdout:48: write initial oid 48 2024-09-16T04:08:17.075 INFO:tasks.rados.rados.0.smithi204.stdout:48: seq_num 47 ranges {0=425984,425984=376832} 2024-09-16T04:08:17.077 INFO:tasks.rados.rados.0.smithi204.stdout:48: writing smithi20431790-48 from 0 to 425984 tid 1 2024-09-16T04:08:17.079 INFO:tasks.rados.rados.0.smithi204.stdout:48: writing smithi20431790-48 from 425984 to 802816 tid 2 2024-09-16T04:08:17.079 INFO:tasks.rados.rados.0.smithi204.stdout:49: write initial oid 49 2024-09-16T04:08:17.079 INFO:tasks.rados.rados.0.smithi204.stdout:49: seq_num 48 ranges {0=442368,442368=376832} 2024-09-16T04:08:17.082 INFO:tasks.rados.rados.0.smithi204.stdout:49: writing smithi20431790-49 from 0 to 442368 tid 1 2024-09-16T04:08:17.084 INFO:tasks.rados.rados.0.smithi204.stdout:49: writing smithi20431790-49 from 442368 to 819200 tid 2 2024-09-16T04:08:17.084 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.085 INFO:tasks.rados.rados.0.smithi204.stdout:35: finishing write tid 1 to smithi20431790-35 2024-09-16T04:08:17.085 INFO:tasks.rados.rados.0.smithi204.stdout:34: finishing write tid 3 to smithi20431790-34 2024-09-16T04:08:17.085 INFO:tasks.rados.rados.0.smithi204.stdout:34: oid 34 updating version 0 to 6 2024-09-16T04:08:17.085 INFO:tasks.rados.rados.0.smithi204.stdout:34: oid 34 version 6 is already newer than 5 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:35: finishing write tid 2 to smithi20431790-35 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:36: finishing write tid 1 to smithi20431790-36 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:34: done (15 left) 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:50: write initial oid 50 2024-09-16T04:08:17.086 INFO:tasks.rados.rados.0.smithi204.stdout:50: seq_num 49 ranges {0=458752,458752=376832} 2024-09-16T04:08:17.087 INFO:tasks.rados.rados.0.smithi204.stdout:50: writing smithi20431790-50 from 0 to 458752 tid 1 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:50: writing smithi20431790-50 from 458752 to 835584 tid 2 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 16 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:36: finishing write tid 2 to smithi20431790-36 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:35: finishing write tid 3 to smithi20431790-35 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:35: oid 35 updating version 0 to 2 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:35: oid 35 version 2 is already newer than 1 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 35 v 2 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:36: finishing write tid 3 to smithi20431790-36 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:36: oid 36 updating version 0 to 4 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:36: oid 36 version 4 is already newer than 3 2024-09-16T04:08:17.091 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 36 v 4 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:37: finishing write tid 1 to smithi20431790-37 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:37: finishing write tid 2 to smithi20431790-37 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:35: done (15 left) 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:36: done (14 left) 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:51: snap_create 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:38: finishing write tid 1 to smithi20431790-38 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:37: finishing write tid 3 to smithi20431790-37 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:37: oid 37 updating version 0 to 4 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:37: oid 37 version 4 is already newer than 3 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 37 v 4 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-09-16T04:08:17.092 INFO:tasks.rados.rados.0.smithi204.stdout:38: finishing write tid 2 to smithi20431790-38 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:38: finishing write tid 3 to smithi20431790-38 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:38: oid 38 updating version 0 to 6 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:38: oid 38 version 6 is already newer than 5 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 38 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:39: finishing write tid 1 to smithi20431790-39 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:39: finishing write tid 2 to smithi20431790-39 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:39: finishing write tid 3 to smithi20431790-39 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:39: oid 39 updating version 0 to 2 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:39: oid 39 version 2 is already newer than 1 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 39 v 2 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:08:17.093 INFO:tasks.rados.rados.0.smithi204.stdout:40: finishing write tid 1 to smithi20431790-40 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:40: finishing write tid 2 to smithi20431790-40 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:41: finishing write tid 1 to smithi20431790-41 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:40: finishing write tid 3 to smithi20431790-40 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:40: oid 40 updating version 0 to 4 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:40: oid 40 version 4 is already newer than 3 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 40 v 4 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:41: finishing write tid 2 to smithi20431790-41 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:42: finishing write tid 1 to smithi20431790-42 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:41: finishing write tid 3 to smithi20431790-41 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:41: oid 41 updating version 0 to 7 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:41: oid 41 updating version 7 to 8 2024-09-16T04:08:17.094 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 41 v 8 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:42: finishing write tid 2 to smithi20431790-42 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:42: finishing write tid 3 to smithi20431790-42 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:42: oid 42 updating version 0 to 9 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:42: oid 42 updating version 9 to 10 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 42 v 10 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:43: finishing write tid 1 to smithi20431790-43 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:43: finishing write tid 2 to smithi20431790-43 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:43: finishing write tid 3 to smithi20431790-43 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:43: oid 43 updating version 0 to 10 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:43: oid 43 version 10 is already newer than 9 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 43 v 10 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-16T04:08:17.095 INFO:tasks.rados.rados.0.smithi204.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:44: finishing write tid 1 to smithi20431790-44 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:44: finishing write tid 2 to smithi20431790-44 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:44: finishing write tid 3 to smithi20431790-44 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:44: oid 44 updating version 0 to 5 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:44: oid 44 updating version 5 to 6 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 6 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:45: finishing write tid 1 to smithi20431790-45 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:45: finishing write tid 2 to smithi20431790-45 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:45: finishing write tid 3 to smithi20431790-45 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:45: oid 45 updating version 0 to 14 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:45: oid 45 version 14 is already newer than 13 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 45 v 14 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-09-16T04:08:17.096 INFO:tasks.rados.rados.0.smithi204.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:46: finishing write tid 1 to smithi20431790-46 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:46: finishing write tid 2 to smithi20431790-46 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:46: finishing write tid 3 to smithi20431790-46 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:46: oid 46 updating version 0 to 5 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:46: oid 46 updating version 5 to 6 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 46 v 6 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:47: finishing write tid 1 to smithi20431790-47 2024-09-16T04:08:17.097 INFO:tasks.rados.rados.0.smithi204.stdout:47: finishing write tid 2 to smithi20431790-47 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: finishing write tid 1 to smithi20431790-48 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: finishing write tid 2 to smithi20431790-48 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:47: finishing write tid 3 to smithi20431790-47 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:47: oid 47 updating version 0 to 4 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:47: oid 47 version 4 is already newer than 3 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 47 v 4 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: finishing write tid 3 to smithi20431790-48 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: finishing write tid 4 to smithi20431790-48 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: oid 48 updating version 0 to 7 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: oid 48 updating version 7 to 9 2024-09-16T04:08:17.098 INFO:tasks.rados.rados.0.smithi204.stdout:48: oid 48 version 9 is already newer than 8 2024-09-16T04:08:17.099 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 48 v 9 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-16T04:08:17.099 INFO:tasks.rados.rados.0.smithi204.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: finishing write tid 1 to smithi20431790-49 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: finishing write tid 2 to smithi20431790-49 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: finishing write tid 3 to smithi20431790-49 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:50: finishing write tid 1 to smithi20431790-50 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: finishing write tid 4 to smithi20431790-49 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: oid 49 updating version 0 to 11 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: oid 49 version 11 is already newer than 9 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:49: oid 49 version 11 is already newer than 10 2024-09-16T04:08:17.100 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 11 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:50: finishing write tid 2 to smithi20431790-50 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:50: finishing write tid 3 to smithi20431790-50 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:50: finishing write tid 4 to smithi20431790-50 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:50: oid 50 updating version 0 to 13 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:50: oid 50 version 13 is already newer than 12 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:50: oid 50 updating version 13 to 14 2024-09-16T04:08:17.101 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 50 v 14 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-16T04:08:17.102 INFO:tasks.rados.rados.0.smithi204.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-09-16T04:08:17.128 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:17.124+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:17.169 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:17.170 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 33/31 ECSubWrite(tid=158, reqid=client.4631.0:10, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.933136+0000", 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.242565847, 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002047821, 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.178 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933136+0000", 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933136+0000", 2024-09-16T04:08:17.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933136+0000", 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.77e-07 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933184+0000", 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8143000000000003e-05 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933211+0000", 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6775999999999999e-05 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933225+0000", 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3644e-05 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933397+0000", 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017245499999999999 2024-09-16T04:08:17.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933408+0000", 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1011e-05 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935136+0000", 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001727262 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935184+0000", 2024-09-16T04:08:17.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8152999999999998e-05 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 33/31 ECSubWrite(tid=159, reqid=client.4631.0:11, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.934326+0000", 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.24137549699999999, 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033430059999999999, 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.183 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934326+0000", 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934326+0000", 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934328+0000", 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.201e-06 2024-09-16T04:08:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934347+0000", 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9831999999999999e-05 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934362+0000", 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4406000000000001e-05 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.185 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934373+0000", 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0903e-05 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934581+0000", 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020844400000000001 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934592+0000", 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1275e-05 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937630+0000", 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030376859999999999 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937669+0000", 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9258999999999998e-05 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 33/31 ECSubWrite(tid=0, reqid=client.4631.0:1, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.187 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.936937+0000", 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.23876450499999999, 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036197389999999999, 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936937+0000", 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.188 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936937+0000", 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936938+0000", 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8700000000000005e-07 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937010+0000", 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1798000000000006e-05 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937026+0000", 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6515e-05 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937038+0000", 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1745e-05 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937131+0000", 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2917000000000005e-05 2024-09-16T04:08:17.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937141+0000", 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8630000000000003e-06 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940522+0000", 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033812500000000001 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940557+0000", 2024-09-16T04:08:17.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4863999999999997e-05 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.941390+0000", 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.23431223700000001, 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0023829480000000002, 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941390+0000", 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941390+0000", 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941391+0000", 2024-09-16T04:08:17.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0330000000000001e-06 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941414+0000", 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2976000000000002e-05 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941434+0000", 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0352000000000001e-05 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941445+0000", 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1075e-05 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941513+0000", 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7657999999999995e-05 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941523+0000", 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0823e-05 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943741+0000", 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002217059 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943773+0000", 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1971999999999998e-05 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 33/31 ECSubWrite(tid=3, reqid=client.4631.0:22, at_version=33'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.943188+0000", 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.23251376300000001, 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031174940000000002, 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943188+0000", 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943188+0000", 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943189+0000", 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.043e-06 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943270+0000", 2024-09-16T04:08:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0853000000000007e-05 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943287+0000", 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7201e-05 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943296+0000", 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3379999999999994e-06 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943363+0000", 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6736000000000006e-05 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943374+0000", 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0635000000000001e-05 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946269+0000", 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002894995 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946306+0000", 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6693000000000003e-05 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 33/31 ECSubWrite(tid=4, reqid=client.4631.0:23, at_version=33'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.946368+0000", 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.229333655, 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032782589999999999, 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946368+0000", 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946368+0000", 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946369+0000", 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4900000000000005e-07 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946387+0000", 2024-09-16T04:08:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8182e-05 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946401+0000", 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3823e-05 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946422+0000", 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1495999999999999e-05 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946490+0000", 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7248000000000004e-05 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946500+0000", 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0498e-05 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949598+0000", 2024-09-16T04:08:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003098164 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949646+0000", 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7998999999999999e-05 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 34/31 ECSubWrite(tid=162, reqid=client.4631.0:37, at_version=34'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.948569+0000", 2024-09-16T04:08:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.22713283000000001, 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033911750000000002, 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948569+0000", 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948569+0000", 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948569+0000", 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7e-07 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948645+0000", 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5679999999999994e-05 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948662+0000", 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6535e-05 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948673+0000", 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1446e-05 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948791+0000", 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011752 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948802+0000", 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1387e-05 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951918+0000", 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031156650000000001 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951960+0000", 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2571999999999998e-05 2024-09-16T04:08:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 34/31 ECSubWrite(tid=163, reqid=client.4631.0:38, at_version=34'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.949821+0000", 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.22588050000000001, 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0021728199999999998, 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949821+0000", 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949821+0000", 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949822+0000", 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2399999999999997e-07 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949842+0000", 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9996e-05 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949862+0000", 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9573e-05 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949873+0000", 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.092e-05 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949939+0000", 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6484999999999998e-05 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949945+0000", 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2639999999999997e-06 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951971+0000", 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0020259940000000001 2024-09-16T04:08:17.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951994+0000", 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2764000000000001e-05 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 34/31 ECSubWrite(tid=18, reqid=client.4631.0:47, at_version=34'8, trim_to=0'0, roll_forward_to=34'5))", 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.985186+0000", 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.19051610099999999, 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013629740000000001, 2024-09-16T04:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985186+0000", 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985186+0000", 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.218 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985187+0000", 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1629999999999999e-06 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985208+0000", 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1364000000000001e-05 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985225+0000", 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6711e-05 2024-09-16T04:08:17.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985233+0000", 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6660000000000008e-06 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985288+0000", 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5646000000000002e-05 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.985301+0000", 2024-09-16T04:08:17.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2809000000000001e-05 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.986514+0000", 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012130070000000001 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.986549+0000", 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4607999999999998e-05 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s2 34/31 ECSubWrite(tid=0, reqid=client.4631.0:76, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.993155+0000", 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.18254632800000001, 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026749260000000002, 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993155+0000", 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993155+0000", 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993156+0000", 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9900000000000001e-07 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993618+0000", 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000462392 2024-09-16T04:08:17.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993640+0000", 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2058000000000001e-05 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993652+0000", 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2164000000000001e-05 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993763+0000", 2024-09-16T04:08:17.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011053299999999999 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.993775+0000", 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2048000000000001e-05 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995789+0000", 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0020139490000000001 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995830+0000", 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1383e-05 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 34/31 ECSubWrite(tid=172, reqid=client.4631.0:82, at_version=34'7, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.997400+0000", 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.17830225499999999, 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001480858, 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.226 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997400+0000", 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997400+0000", 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997401+0000", 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.11e-06 2024-09-16T04:08:17.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997460+0000", 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.9169000000000002e-05 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997478+0000", 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8094e-05 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997488+0000", 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0039e-05 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997563+0000", 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5207e-05 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.997573+0000", 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0318e-05 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.998840+0000", 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001266128 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.998880+0000", 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0793000000000001e-05 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 34/31 ECSubWrite(tid=4, reqid=client.4631.0:97, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:17.230 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.015364+0000", 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.160337697, 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0015455060000000001, 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.015364+0000", 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.015364+0000", 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.015364+0000", 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8999999999999998e-07 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.015964+0000", 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00059915599999999999 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.015977+0000", 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3217000000000001e-05 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.015985+0000", 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1640000000000001e-06 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.016049+0000", 2024-09-16T04:08:17.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4330000000000002e-05 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.016058+0000", 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9209999999999998e-06 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.016870+0000", 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00081136000000000001 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.016910+0000", 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0068000000000003e-05 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s2 34/31 ECSubWrite(tid=4, reqid=client.4631.0:106, at_version=34'3, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.027831+0000", 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.14787045700000001, 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002290285, 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.235 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.027831+0000", 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.027831+0000", 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.236 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.027833+0000", 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.364e-06 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028159+0000", 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00032585900000000001 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028196+0000", 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7636999999999999e-05 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.237 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028206+0000", 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.431e-06 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028293+0000", 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7177999999999998e-05 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028306+0000", 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3027000000000001e-05 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030058+0000", 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001752151 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030122+0000", 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3638000000000003e-05 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.239 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s2 34/31 ECSubWrite(tid=6, reqid=client.4631.0:107, at_version=0'0, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.031968+0000", 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.14373424900000001, 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0016219349999999999, 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.031968+0000", 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.031968+0000", 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.031968+0000", 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9800000000000002e-07 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.031983+0000", 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4531e-05 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.031999+0000", 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6061000000000001e-05 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.032008+0000", 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4800000000000001e-06 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.032089+0000", 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1627999999999998e-05 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.032097+0000", 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0390000000000005e-06 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.033036+0000", 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00093901499999999997 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.033589+0000", 2024-09-16T04:08:17.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00055328300000000001 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 34/31 ECSubWrite(tid=12, reqid=client.4631.0:118, at_version=34'3, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.044077+0000", 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.13162442799999999, 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001455858, 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.244 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044077+0000", 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044077+0000", 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044079+0000", 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.581e-06 2024-09-16T04:08:17.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044280+0000", 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020139800000000001 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044299+0000", 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8726999999999999e-05 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044311+0000", 2024-09-16T04:08:17.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1875999999999999e-05 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044375+0000", 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3655e-05 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044381+0000", 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5060000000000001e-06 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045489+0000", 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001107701 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045533+0000", 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4413999999999999e-05 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 34/31 ECSubWrite(tid=13, reqid=client.4631.0:119, at_version=34'4, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:17.248 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.044683+0000", 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.13101859399999999, 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036719470000000001, 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044683+0000", 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.249 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044683+0000", 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044684+0000", 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4799999999999998e-07 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044702+0000", 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8221000000000001e-05 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044712+0000", 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5670000000000001e-06 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044720+0000", 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8519999999999993e-06 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044787+0000", 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6511000000000001e-05 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044805+0000", 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7907999999999999e-05 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048311+0000", 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035057410000000002 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048355+0000", 2024-09-16T04:08:17.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4598999999999998e-05 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 34/31 ECSubWrite(tid=181, reqid=client.4631.0:128, at_version=34'10, trim_to=0'0, roll_forward_to=34'8))", 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.058470+0000", 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.11723204299999999, 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027856090000000001, 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058470+0000", 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058470+0000", 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058471+0000", 2024-09-16T04:08:17.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3600000000000002e-07 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058491+0000", 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0282e-05 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058505+0000", 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4476e-05 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.255 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058515+0000", 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6260000000000007e-06 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058569+0000", 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3862e-05 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058583+0000", 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4175999999999999e-05 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061198+0000", 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002615371 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061255+0000", 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.698e-05 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 34/31 ECSubWrite(tid=182, reqid=client.4631.0:128, at_version=0'0, trim_to=0'0, roll_forward_to=34'10))", 2024-09-16T04:08:17.257 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.061723+0000", 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.113979016, 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0022896259999999999, 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061723+0000", 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061723+0000", 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061724+0000", 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8800000000000001e-07 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061734+0000", 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0566e-05 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.259 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061751+0000", 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6344000000000001e-05 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061760+0000", 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.1789999999999997e-06 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061814+0000", 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4190000000000001e-05 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.260 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061823+0000", 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6179999999999995e-06 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.063974+0000", 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0021511630000000002 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.064012+0000", 2024-09-16T04:08:17.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8677999999999998e-05 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 34/31 ECSubWrite(tid=16, reqid=client.4631.0:136, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.071747+0000", 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.103954776, 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001712833, 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.262 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.071747+0000", 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.071747+0000", 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.071749+0000", 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5829999999999999e-06 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072165+0000", 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00041653399999999998 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072185+0000", 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0057000000000001e-05 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072196+0000", 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1001e-05 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072326+0000", 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012996700000000001 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072356+0000", 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0185e-05 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.073415+0000", 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010588590000000001 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.073460+0000", 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4647000000000001e-05 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 34/31 ECSubWrite(tid=17, reqid=client.4631.0:137, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.072832+0000", 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.102869776, 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0034954090000000001, 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.267 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072832+0000", 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072832+0000", 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072833+0000", 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0070000000000001e-06 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072851+0000", 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8014999999999999e-05 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072864+0000", 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3039e-05 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072875+0000", 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0942e-05 2024-09-16T04:08:17.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072974+0000", 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9112999999999998e-05 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.072984+0000", 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0115000000000001e-05 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:17.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.076293+0000", 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033085319999999999 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.076327+0000", 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4646e-05 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:17.271 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:17.272 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:17.273 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:17.273 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:17.274 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:08:17.275 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:17.275 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:17.275 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:17.275 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:17.276 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:17.276 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:17.277 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:17.267+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:17.277 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 130 (0%) 2024-09-16T04:08:17.277 INFO:teuthology.orchestra.run.smithi032.stdout:avg 8.125 2024-09-16T04:08:17.277 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 2.52178 -> 2.52178 (expected baseline 2.75993) 2024-09-16T04:08:17.277 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.3 with 4 -> 4 pgs (0.492308 -> 0.492308 * mean) 2024-09-16T04:08:17.277 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.11 with 13 -> 13 pgs (1.6 -> 1.6 * mean) 2024-09-16T04:08:17.277 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stdout:oload 110 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 1 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0003 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 weight 1.0000 -> 0.8965 2024-09-16T04:08:17.278 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:08:17.272+0000 7f8a2e7e0640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-16T04:08:17.278 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-16T04:08:17.290 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:17.290 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:17.295 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-16T04:08:17.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-16T04:08:17.311 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:17.311 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:17.327 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:17.348 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:17.348 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:17.368 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:17.369 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:17.373 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:17.368+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:17.389 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:17.389 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:17.407 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:17.407 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:17.410 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:17.411 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:17.424 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:08:17.428 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:17.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:17.426+0000 7fd6c5327640 0 -- 172.21.15.32:0/836480966 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7fd6c0220570 msgr2=0x7fd6c0222960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:17.473 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:17.470+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:17.575 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:17.572+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:17.588 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:17.588 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:17.602 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:08:17.602 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 130 (0%) 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:avg 8.125 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 2.52178 -> 2.52178 (expected baseline 2.75993) 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.3 with 4 -> 4 pgs (0.492308 -> 0.492308 * mean) 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.11 with 13 -> 13 pgs (1.6 -> 1.6 * mean) 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 0.05 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-16T04:08:17.603 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0030 2024-09-16T04:08:17.604 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-16T04:08:17.620 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-16T04:08:17.620 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-16T04:08:17.656 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:17.657 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:17.675 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:17.675 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:17.676 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:17.670+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:17.765 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:17.766 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:17.776 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:17.771+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:17.779 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:08:17.877 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:17.874+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:17.904 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:17.918 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:08:17.928 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:37: done (14 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:38: done (13 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:39: done (12 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:40: done (11 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:41: done (10 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:42: done (9 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:43: done (8 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:44: done (7 left) 2024-09-16T04:08:17.932 INFO:tasks.rados.rados.0.smithi204.stdout:45: done (6 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:46: done (5 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:47: done (4 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:48: done (3 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:49: done (2 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:50: done (1 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:51: done (0 left) 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 18 current snap is 1 2024-09-16T04:08:17.933 INFO:tasks.rados.rados.0.smithi204.stdout:52: seq_num 50 ranges {294912=475136,770048=376832} 2024-09-16T04:08:17.936 INFO:tasks.rados.rados.0.smithi204.stdout:52: writing smithi20431790-18 from 294912 to 770048 tid 1 2024-09-16T04:08:17.938 INFO:tasks.rados.rados.0.smithi204.stdout:52: writing smithi20431790-18 from 770048 to 1146880 tid 2 2024-09-16T04:08:17.938 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 8 current snap is 1 2024-09-16T04:08:17.938 INFO:tasks.rados.rados.0.smithi204.stdout:53: seq_num 51 ranges {131072=491520,622592=376832} 2024-09-16T04:08:17.941 INFO:tasks.rados.rados.0.smithi204.stdout:53: writing smithi20431790-8 from 131072 to 622592 tid 1 2024-09-16T04:08:17.944 INFO:tasks.rados.rados.0.smithi204.stdout:53: writing smithi20431790-8 from 622592 to 999424 tid 2 2024-09-16T04:08:17.944 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 5 current snap is 1 2024-09-16T04:08:17.944 INFO:tasks.rados.rados.0.smithi204.stdout:54: seq_num 52 ranges {81920=507904,589824=376832} 2024-09-16T04:08:17.947 INFO:tasks.rados.rados.0.smithi204.stdout:54: writing smithi20431790-5 from 81920 to 589824 tid 1 2024-09-16T04:08:17.950 INFO:tasks.rados.rados.0.smithi204.stdout:54: writing smithi20431790-5 from 589824 to 966656 tid 2 2024-09-16T04:08:17.950 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 43 current snap is 1 2024-09-16T04:08:17.950 INFO:tasks.rados.rados.0.smithi204.stdout:55: seq_num 53 ranges {720896=524288,1245184=376832} 2024-09-16T04:08:17.957 INFO:tasks.rados.rados.0.smithi204.stdout:55: writing smithi20431790-43 from 720896 to 1245184 tid 1 2024-09-16T04:08:17.960 INFO:tasks.rados.rados.0.smithi204.stdout:55: writing smithi20431790-43 from 1245184 to 1622016 tid 2 2024-09-16T04:08:17.960 INFO:tasks.rados.rados.0.smithi204.stdout:56: delete oid 30 current snap is 1 2024-09-16T04:08:17.960 INFO:tasks.rados.rados.0.smithi204.stdout:52: finishing write tid 1 to smithi20431790-18 2024-09-16T04:08:17.960 INFO:tasks.rados.rados.0.smithi204.stdout:52: finishing write tid 2 to smithi20431790-18 2024-09-16T04:08:17.960 INFO:tasks.rados.rados.0.smithi204.stdout:52: finishing write tid 3 to smithi20431790-18 2024-09-16T04:08:17.960 INFO:tasks.rados.rados.0.smithi204.stdout:52: finishing write tid 4 to smithi20431790-18 2024-09-16T04:08:17.961 INFO:tasks.rados.rados.0.smithi204.stdout:52: oid 18 updating version 0 to 14 2024-09-16T04:08:17.961 INFO:tasks.rados.rados.0.smithi204.stdout:52: oid 18 version 14 is already newer than 13 2024-09-16T04:08:17.961 INFO:tasks.rados.rados.0.smithi204.stdout:52: oid 18 version 14 is already newer than 12 2024-09-16T04:08:17.961 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 18 v 14 (ObjNum 50 snap 1 seq_num 50) dirty exists 2024-09-16T04:08:17.961 INFO:tasks.rados.rados.0.smithi204.stdout:52: left oid 18 (ObjNum 50 snap 1 seq_num 50) 2024-09-16T04:08:17.961 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 130 (0%) 2024-09-16T04:08:17.961 INFO:teuthology.orchestra.run.smithi032.stdout:avg 8.125 2024-09-16T04:08:17.961 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 2.52178 -> 2.52178 (expected baseline 2.75993) 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.3 with 4 -> 4 pgs (0.492308 -> 0.492308 * mean) 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.11 with 13 -> 13 pgs (1.6 -> 1.6 * mean) 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 0.05 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0030 2024-09-16T04:08:17.962 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-16T04:08:17.963 INFO:tasks.rados.rados.0.smithi204.stdout:53: finishing write tid 1 to smithi20431790-8 2024-09-16T04:08:17.965 INFO:tasks.rados.rados.0.smithi204.stdout:55: finishing write tid 1 to smithi20431790-43 2024-09-16T04:08:17.967 INFO:tasks.rados.rados.0.smithi204.stdout:54: finishing write tid 1 to smithi20431790-5 2024-09-16T04:08:17.967 INFO:tasks.rados.rados.0.smithi204.stdout:53: finishing write tid 2 to smithi20431790-8 2024-09-16T04:08:17.967 INFO:tasks.rados.rados.0.smithi204.stdout:55: finishing write tid 2 to smithi20431790-43 2024-09-16T04:08:17.970 INFO:tasks.rados.rados.0.smithi204.stdout:55: finishing write tid 3 to smithi20431790-43 2024-09-16T04:08:17.971 INFO:tasks.rados.rados.0.smithi204.stdout:53: finishing write tid 3 to smithi20431790-8 2024-09-16T04:08:17.971 INFO:tasks.rados.rados.0.smithi204.stdout:54: finishing write tid 2 to smithi20431790-5 2024-09-16T04:08:17.971 INFO:tasks.rados.rados.0.smithi204.stdout:54: finishing write tid 3 to smithi20431790-5 2024-09-16T04:08:17.972 INFO:tasks.rados.rados.0.smithi204.stdout:55: finishing write tid 4 to smithi20431790-43 2024-09-16T04:08:17.972 INFO:tasks.rados.rados.0.smithi204.stdout:55: oid 43 updating version 0 to 13 2024-09-16T04:08:17.972 INFO:tasks.rados.rados.0.smithi204.stdout:55: oid 43 updating version 13 to 14 2024-09-16T04:08:17.972 INFO:tasks.rados.rados.0.smithi204.stdout:55: oid 43 version 14 is already newer than 12 2024-09-16T04:08:17.972 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 43 v 14 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-09-16T04:08:17.972 INFO:tasks.rados.rados.0.smithi204.stdout:55: left oid 43 (ObjNum 53 snap 1 seq_num 53) 2024-09-16T04:08:17.974 INFO:tasks.rados.rados.0.smithi204.stdout:52: done (4 left) 2024-09-16T04:08:17.974 INFO:tasks.rados.rados.0.smithi204.stdout:55: done (3 left) 2024-09-16T04:08:17.974 INFO:tasks.rados.rados.0.smithi204.stdout:56: done (2 left) 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:57: rmattr oid 6 current snap is 1 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:57: done (2 left) 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:58: copy_from oid 19 from oid 36 current snap is 1 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:59: copy_from oid 32 from oid 10 current snap is 1 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:60: rollback oid 14 current snap is 1 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 14 to 0 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:61: snap_create 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:53: finishing write tid 4 to smithi20431790-8 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:53: oid 8 updating version 0 to 18 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:53: oid 8 version 18 is already newer than 16 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:53: oid 8 version 18 is already newer than 17 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 8 v 18 (ObjNum 51 snap 1 seq_num 51) dirty exists 2024-09-16T04:08:17.975 INFO:tasks.rados.rados.0.smithi204.stdout:53: left oid 8 (ObjNum 51 snap 1 seq_num 51) 2024-09-16T04:08:17.976 INFO:tasks.rados.rados.0.smithi204.stdout:54: finishing write tid 4 to smithi20431790-5 2024-09-16T04:08:17.976 INFO:tasks.rados.rados.0.smithi204.stdout:54: oid 5 updating version 0 to 18 2024-09-16T04:08:17.976 INFO:tasks.rados.rados.0.smithi204.stdout:54: oid 5 version 18 is already newer than 16 2024-09-16T04:08:17.976 INFO:tasks.rados.rados.0.smithi204.stdout:54: oid 5 version 18 is already newer than 17 2024-09-16T04:08:17.977 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 18 (ObjNum 52 snap 1 seq_num 52) dirty exists 2024-09-16T04:08:17.977 INFO:tasks.rados.rados.0.smithi204.stdout:54: left oid 5 (ObjNum 52 snap 1 seq_num 52) 2024-09-16T04:08:17.978 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:17.978+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:17.982 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-16T04:08:17.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-16T04:08:17.983 INFO:tasks.rados.rados.0.smithi204.stdout:59: finishing copy_from racing read to smithi20431790-32 2024-09-16T04:08:17.986 INFO:tasks.rados.rados.0.smithi204.stdout:59: finishing copy_from to smithi20431790-32 2024-09-16T04:08:17.986 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 32 v 6 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-16T04:08:17.987 INFO:tasks.rados.rados.0.smithi204.stdout:60: finishing rollback tid 0 to smithi20431790-14 2024-09-16T04:08:17.987 INFO:tasks.rados.rados.0.smithi204.stdout:60: finishing rollback tid 1 to smithi20431790-14 2024-09-16T04:08:17.992 INFO:tasks.rados.rados.0.smithi204.stdout:58: finishing copy_from racing read to smithi20431790-19 2024-09-16T04:08:17.994 INFO:tasks.rados.rados.0.smithi204.stdout:60: finishing rollback tid 2 to smithi20431790-14 2024-09-16T04:08:17.994 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 14 v 24 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-16T04:08:17.994 INFO:tasks.rados.rados.0.smithi204.stdout:58: finishing copy_from to smithi20431790-19 2024-09-16T04:08:17.994 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 19 v 4 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-16T04:08:18.050 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:18.051 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:18.065 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:08:18.079 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:18.078+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:18.180 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:18.178+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:18.232 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:18.233 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:18.247 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:08:18.294 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:18.292+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:18.313 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-16T04:08:18.308+0000 7f8a2e7e0640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 130 (0%) 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:avg 8.125 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 2.52178 -> 2.52178 (expected baseline 2.75993) 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.3 with 4 -> 4 pgs (0.492308 -> 0.492308 * mean) 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.11 with 13 -> 13 pgs (1.6 -> 1.6 * mean) 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:oload 110 2024-09-16T04:08:18.315 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 0.05 2024-09-16T04:08:18.315 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-16T04:08:18.315 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-16T04:08:18.315 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0003 2024-09-16T04:08:18.315 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-16T04:08:18.315 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-16T04:08:18.333 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-16T04:08:18.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-16T04:08:18.370 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:18.371 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:18.382 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:18.378+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:18.384 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:08:18.483 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:18.480+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:18.549 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:18.549 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:18.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:08:18.584 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:18.582+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:18.626 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 130 (0%) 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:avg 8.125 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 2.52178 -> 2.52178 (expected baseline 2.75993) 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.3 with 4 -> 4 pgs (0.492308 -> 0.492308 * mean) 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.11 with 13 -> 13 pgs (1.6 -> 1.6 * mean) 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 0.05 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-16T04:08:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0030 2024-09-16T04:08:18.628 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-16T04:08:18.685 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:18.682+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:18.731 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:18.731 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:18.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:18.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:18.783+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:18.865 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:18.865 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:18.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:08:18.886 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:18.883+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:53: done (5 left) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:54: done (4 left) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:58: done (3 left) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:59: done (2 left) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:60: done (1 left) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:61: done (0 left) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:62: read oid 7 snap 1 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:62: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-16T04:08:18.948 INFO:tasks.rados.rados.0.smithi204.stdout:63: snap_create 2024-09-16T04:08:18.960 INFO:tasks.rados.rados.0.smithi204.stdout:62: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-16T04:08:18.987 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:18.985+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:19.008 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.008 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:08:19.088 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:19.084+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:19.148 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.149 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:08:19.189 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:19.184+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:19.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:19.287+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:19.291 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.291 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:08:19.392 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:19.388+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:19.432 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.432 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:08:19.492 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:19.488+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:19.574 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.574 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:08:19.596 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:19.590+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:19.694 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:19.693+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:19.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:19.722 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.723 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:08:19.795 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:19.791+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:19.841 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:19.842 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:19.863 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:19.863 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:19.896 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:19.892+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:19.907 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:19.908 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:19.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:08:19.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-16T04:08:19.951 INFO:tasks.rados.rados.0.smithi204.stdout:62: done (1 left) 2024-09-16T04:08:19.951 INFO:tasks.rados.rados.0.smithi204.stdout:63: done (0 left) 2024-09-16T04:08:19.951 INFO:tasks.rados.rados.0.smithi204.stdout:64: delete oid 35 current snap is 3 2024-09-16T04:08:19.966 INFO:tasks.rados.rados.0.smithi204.stdout:64: done (0 left) 2024-09-16T04:08:19.966 INFO:tasks.rados.rados.0.smithi204.stdout:65: snap_remove snap 1 2024-09-16T04:08:19.997 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:19.995+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:20.047 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:20.047 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:20.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:08:20.088 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:20.088 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:20.098 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:20.097+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:20.112 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:20.112 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:20.145 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:20.145 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:20.177 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:20.178 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:20.189 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:20.189 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:20.199 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:20.194+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:20.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:08:20.214 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:20.214 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:20.235 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:20.235 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:20.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:20.252 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:20.273 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:20.273 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:20.294 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:20.294 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:20.299 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:20.294+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:20.315 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:20.330 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:20.330 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:20.343 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:20.344 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:20.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:08:20.364 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:20.365 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:20.385 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:20.385 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:20.400 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:20.394+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:20.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:20.402+0000 7fc626afd640 0 -- 172.21.15.32:0/1590065604 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7fc620223d30 msgr2=0x7fc620226120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:20.410 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:20.483 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:20.483 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:20.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.2s1 33/31 ECSubWrite(tid=158, reqid=client.4631.0:10, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.934727+0000", 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5472042310000003, 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003842243, 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934727+0000", 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934727+0000", 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934728+0000", 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9600000000000008e-07 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934832+0000", 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010484600000000001 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934855+0000", 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2260999999999999e-05 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934869+0000", 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4034e-05 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936503+0000", 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001634075 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936521+0000", 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7751e-05 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.938521+0000", 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020009429999999998 2024-09-16T04:08:20.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.938569+0000", 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7336999999999998e-05 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.2s1 33/31 ECSubWrite(tid=159, reqid=client.4631.0:11, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.935828+0000", 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5461024459999999, 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035586670000000002, 2024-09-16T04:08:20.488 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935828+0000", 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935828+0000", 2024-09-16T04:08:20.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935834+0000", 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.305e-06 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935856+0000", 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2758000000000001e-05 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935873+0000", 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6606e-05 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935883+0000", 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0152e-05 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.937083+0000", 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001200326 2024-09-16T04:08:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.937095+0000", 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1959e-05 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.939323+0000", 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002227878 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.939387+0000", 2024-09-16T04:08:20.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3683000000000007e-05 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s1 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942457+0000", 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5394737420000002, 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029936020000000002, 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:20.493 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942457+0000", 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942457+0000", 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942458+0000", 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6199999999999997e-07 2024-09-16T04:08:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942481+0000", 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3493e-05 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942497+0000", 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6084000000000001e-05 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942510+0000", 2024-09-16T04:08:20.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2138e-05 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942682+0000", 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017296600000000001 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942695+0000", 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2381999999999999e-05 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945302+0000", 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026075600000000001 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945451+0000", 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014821699999999999 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs1 33/31 ECSubWrite(tid=4, reqid=client.4631.0:19, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942576+0000", 2024-09-16T04:08:20.497 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5393549129999999, 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002867788, 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942576+0000", 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942576+0000", 2024-09-16T04:08:20.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942576+0000", 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000000000000002e-07 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942721+0000", 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144566 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942738+0000", 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6889999999999999e-05 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942747+0000", 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8430000000000005e-06 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942902+0000", 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015448999999999999 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942936+0000", 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3861e-05 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945242+0000", 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023066480000000001 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945444+0000", 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020121000000000001 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.501 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:31 3.9s0 3:93634e21:::smithi20431790-11:head [append 0~180224,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5342458260000003, 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015779225000000001, 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.502 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 31 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947688+0000", 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.599e-06 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948028+0000", 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000340491 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948040+0000", 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1488000000000001e-05 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948046+0000", 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948165+0000", 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011934000000000001 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948369+0000", 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020333999999999999 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949522+0000", 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001153435 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951355+0000", 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001833386 2024-09-16T04:08:20.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963404+0000", 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012048644000000001 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963464+0000", 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0044999999999999e-05 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:32 3.9s0 3:93634e21:::smithi20431790-11:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5338631349999998, 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015702510999999999, 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 32 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2600000000000002e-07 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948073+0000", 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6700000000000002e-06 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948082+0000", 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-06 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948090+0000", 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9729999999999997e-06 2024-09-16T04:08:20.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950170+0000", 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020803670000000001 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950297+0000", 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127062 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950926+0000", 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062826500000000003 2024-09-16T04:08:20.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951904+0000", 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000978694 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963618+0000", 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011714096 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963770+0000", 2024-09-16T04:08:20.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015180799999999999 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:33 3.9s0 3:93634e21:::smithi20431790-11:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5338072020000002, 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018249636999999999, 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.513 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 33 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948125+0000", 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.159e-06 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948130+0000", 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5559999999999998e-06 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948145+0000", 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5057e-05 2024-09-16T04:08:20.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948155+0000", 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7040000000000006e-06 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951232+0000", 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077069 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951336+0000", 2024-09-16T04:08:20.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103558 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964171+0000", 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012834887999999999 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964283+0000", 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112611 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966373+0000", 2024-09-16T04:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020900350000000001 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.2s1 34/31 ECSubWrite(tid=165, reqid=client.4631.0:43, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.956536+0000", 2024-09-16T04:08:20.518 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5253951610000001, 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035820079999999998, 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956536+0000", 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956536+0000", 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956537+0000", 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956643+0000", 2024-09-16T04:08:20.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106234 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956659+0000", 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6265000000000001e-05 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956670+0000", 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0557000000000001e-05 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956790+0000", 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120411 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956801+0000", 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1026000000000001e-05 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.960045+0000", 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032434949999999999 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.960118+0000", 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3065999999999995e-05 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:97 3.0s0 3:0daec8ce:::smithi20431790-33:head [append 0~540672,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.014873+0000", 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4670581870000001, 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060881340000000003, 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.014873+0000", 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.014873+0000", 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.014875+0000", 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0090000000000002e-06 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015314+0000", 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000439531 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015336+0000", 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2225000000000002e-05 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015349+0000", 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2242000000000001e-05 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015424+0000", 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4950999999999994e-05 2024-09-16T04:08:20.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015529+0000", 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010540299999999999 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.016365+0000", 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083623599999999997 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018662+0000", 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022967030000000002 2024-09-16T04:08:20.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.020904+0000", 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022418849999999999 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.020961+0000", 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6949e-05 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:98 3.0s0 3:0daec8ce:::smithi20431790-33:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.015377+0000", 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4665532849999998, 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060898829999999999, 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 98 2024-09-16T04:08:20.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015377+0000", 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015377+0000", 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015378+0000", 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6899999999999996e-07 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015383+0000", 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9230000000000001e-06 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015405+0000", 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1662999999999999e-05 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015413+0000", 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0399999999999993e-06 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.017323+0000", 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001909808 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.017444+0000", 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105200000000001 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.017882+0000", 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043772499999999997 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018687+0000", 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080527500000000004 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021370+0000", 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026832639999999999 2024-09-16T04:08:20.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021467+0000", 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7263999999999996e-05 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:99 3.0s0 3:0daec8ce:::smithi20431790-33:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4665039719999999, 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008043718, 2024-09-16T04:08:20.534 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 99 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:20.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0299999999999999e-07 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015431+0000", 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9940000000000002e-06 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015441+0000", 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015448+0000", 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018104+0000", 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026563300000000001 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018194+0000", 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9544999999999997e-05 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021888+0000", 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036945709999999998 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.022023+0000", 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013508899999999999 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.023471+0000", 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001447343 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:109 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~606208,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4516474399999999, 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069726889999999998, 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 109 2024-09-16T04:08:20.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030285+0000", 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8330000000000001e-06 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030998+0000", 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071285399999999996 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031011+0000", 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2935000000000001e-05 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031017+0000", 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031073+0000", 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6746999999999997e-05 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031204+0000", 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013035600000000001 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032021+0000", 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081749100000000005 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033799+0000", 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001777666 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037138+0000", 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00333943 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037256+0000", 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117754 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:110 3.9s0 3:9410ed93:::smithi20431790-37:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.031035+0000", 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4508956250000002, 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064136970000000003, 2024-09-16T04:08:20.545 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 110 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031035+0000", 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031035+0000", 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031036+0000", 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9699999999999995e-07 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031040+0000", 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3880000000000002e-06 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031049+0000", 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2339999999999994e-06 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031055+0000", 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0079999999999999e-06 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032513+0000", 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014581279999999999 2024-09-16T04:08:20.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032621+0000", 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108658 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033187+0000", 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056515500000000002 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.034255+0000", 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001068463 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037364+0000", 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031091529999999999 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037449+0000", 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4713e-05 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:111 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4508664649999998, 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085961969999999999, 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.551 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031065+0000", 2024-09-16T04:08:20.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0100000000000005e-07 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031067+0000", 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031075+0000", 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.498e-06 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031080+0000", 2024-09-16T04:08:20.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3159999999999996e-06 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033632+0000", 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025523619999999999 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033720+0000", 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7457e-05 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037855+0000", 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041353259999999999 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037942+0000", 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7039999999999993e-05 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039661+0000", 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001718327 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:118 3.0s0 3:04de99e5:::smithi20431790-40:head [append 0~671744,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4399459370000001, 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078732079999999996, 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 118 2024-09-16T04:08:20.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041987+0000", 2024-09-16T04:08:20.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042717+0000", 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073003100000000002 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042741+0000", 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4037e-05 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042755+0000", 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3828e-05 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042940+0000", 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018496100000000001 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.043139+0000", 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019973899999999999 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044207+0000", 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001067822 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045575+0000", 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013682729999999999 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049772+0000", 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041967660000000002 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049858+0000", 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5833000000000003e-05 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:119 3.0s0 3:04de99e5:::smithi20431790-40:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4391437489999999, 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072748409999999998, 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.561 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 119 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042788+0000", 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.031e-06 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042794+0000", 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5969999999999999e-06 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042805+0000", 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1375999999999999e-05 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042812+0000", 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.613e-06 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044774+0000", 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019619059999999998 2024-09-16T04:08:20.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044887+0000", 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011298600000000001 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045362+0000", 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047594299999999999 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045858+0000", 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000495193 2024-09-16T04:08:20.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049963+0000", 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041055500000000003 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050062+0000", 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8646000000000004e-05 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.566 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:120 3.0s0 3:04de99e5:::smithi20431790-40:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4391087539999998, 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091318960000000005, 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 120 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042823+0000", 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0699999999999997e-07 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042825+0000", 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.441e-06 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042834+0000", 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4099999999999997e-06 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042840+0000", 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.728e-06 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045635+0000", 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027951059999999999 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045745+0000", 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109392 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050479+0000", 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047341659999999997 2024-09-16T04:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050579+0000", 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9852999999999994e-05 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.051954+0000", 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013752930000000001 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:136 3.0s0 3:0316444d:::smithi20431790-46:head [append 0~770048,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4111154730000002, 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006793075, 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070817+0000", 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.911e-06 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071720+0000", 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00090319599999999999 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071743+0000", 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3003e-05 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071755+0000", 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1157e-05 2024-09-16T04:08:20.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071832+0000", 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7206999999999994e-05 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071946+0000", 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114251 2024-09-16T04:08:20.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.072639+0000", 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069292699999999997 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074184+0000", 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015451639999999999 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077540+0000", 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556760000000001 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077608+0000", 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8583000000000004e-05 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:137 3.0s0 3:0316444d:::smithi20431790-46:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071782+0000", 2024-09-16T04:08:20.577 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.410148489, 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067502279999999996, 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071782+0000", 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071782+0000", 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071783+0000", 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999997e-07 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071789+0000", 2024-09-16T04:08:20.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2260000000000002e-06 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071800+0000", 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.078e-05 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071807+0000", 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7789999999999998e-06 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.073234+0000", 2024-09-16T04:08:20.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014268620000000001 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.073293+0000", 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9358000000000003e-05 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.073818+0000", 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052522400000000003 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:20.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074285+0000", 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046693199999999998 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078459+0000", 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041739710000000003 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078533+0000", 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3209999999999999e-05 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:138 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.410110602, 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098477340000000003, 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-16T04:08:20.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071821+0000", 2024-09-16T04:08:20.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0399999999999996e-07 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071824+0000", 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9639999999999999e-06 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071833+0000", 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7879999999999995e-06 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:20.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071839+0000", 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9959999999999999e-06 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074071+0000", 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022326329999999999 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074173+0000", 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101989 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:20.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078912+0000", 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047384030000000004 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078998+0000", 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6192000000000004e-05 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081668+0000", 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002670165 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:20.588 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:20.588 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:20.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:08:20.590 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:20.588+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:20.690 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:20.688+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:20.725 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:20.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:20.725 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:20.725 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:20.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:08:20.791 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:20.791+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:20.865 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:20.865 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:20.865 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:20.865 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:20.866 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:20.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:08:20.891 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:20.888+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-16T04:08:20.967 INFO:tasks.rados.rados.0.smithi204.stdout:65: done (0 left) 2024-09-16T04:08:20.967 INFO:tasks.rados.rados.0.smithi204.stdout:66: delete oid 20 current snap is 3 2024-09-16T04:08:20.978 INFO:tasks.rados.rados.0.smithi204.stdout:66: done (0 left) 2024-09-16T04:08:20.978 INFO:tasks.rados.rados.0.smithi204.stdout:67: snap_create 2024-09-16T04:08:20.993 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:20.989+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:21.019 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:21.019 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:21.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:21.019 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 33/31 ECSubWrite(tid=158, reqid=client.4631.0:10, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934647+0000", 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0826732100000003, 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037757870000000001, 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934647+0000", 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934647+0000", 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934648+0000", 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1699999999999999e-07 2024-09-16T04:08:21.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934771+0000", 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000123659 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934812+0000", 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0500000000000002e-05 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934835+0000", 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3210999999999999e-05 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935161+0000", 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032566000000000002 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935206+0000", 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5429000000000002e-05 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938336+0000", 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003130112 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938423+0000", 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6798999999999993e-05 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 33/31 ECSubWrite(tid=1, reqid=client.4631.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.935700+0000", 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0816205349999999, 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053906190000000001, 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935700+0000", 2024-09-16T04:08:21.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935700+0000", 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935702+0000", 2024-09-16T04:08:21.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5430000000000001e-06 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936039+0000", 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033735200000000002 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936073+0000", 2024-09-16T04:08:21.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3590999999999997e-05 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936095+0000", 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2378000000000002e-05 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936363+0000", 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026768700000000001 2024-09-16T04:08:21.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936388+0000", 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5610999999999999e-05 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941001+0000", 2024-09-16T04:08:21.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046132580000000003 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941091+0000", 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9198999999999998e-05 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.030 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.031 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 33/31 ECSubWrite(tid=159, reqid=client.4631.0:11, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.031 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936225+0000", 2024-09-16T04:08:21.031 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.081095672, 2024-09-16T04:08:21.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043802559999999999, 2024-09-16T04:08:21.032 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.032 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936225+0000", 2024-09-16T04:08:21.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936225+0000", 2024-09-16T04:08:21.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936226+0000", 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.477e-06 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936320+0000", 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3875000000000005e-05 2024-09-16T04:08:21.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936349+0000", 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8724000000000001e-05 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936381+0000", 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2190999999999997e-05 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937058+0000", 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067654599999999998 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937082+0000", 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4195000000000001e-05 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940513+0000", 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003431576 2024-09-16T04:08:21.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940605+0000", 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1671999999999999e-05 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0803910810000001, 2024-09-16T04:08:21.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080395369999999994, 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936932+0000", 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0530000000000001e-06 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937019+0000", 2024-09-16T04:08:21.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7212000000000005e-05 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937052+0000", 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3331000000000003e-05 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937092+0000", 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9437000000000002e-05 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937324+0000", 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023248400000000001 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937349+0000", 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5398e-05 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944874+0000", 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075243269999999999 2024-09-16T04:08:21.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944969+0000", 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5295000000000002e-05 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:21.043 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0754192409999996, 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063272570000000002, 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941903+0000", 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.457e-06 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942075+0000", 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017237900000000001 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942114+0000", 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8433000000000003e-05 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942137+0000", 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3442e-05 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944009+0000", 2024-09-16T04:08:21.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018714789999999999 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944031+0000", 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2912e-05 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948133+0000", 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041011930000000004 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948229+0000", 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5962e-05 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0749737179999999, 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059926320000000003, 2024-09-16T04:08:21.048 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942348+0000", 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2300000000000001e-06 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942388+0000", 2024-09-16T04:08:21.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0377000000000003e-05 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942419+0000", 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0957000000000002e-05 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942449+0000", 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9578e-05 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945390+0000", 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029405360000000001 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945413+0000", 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3901999999999999e-05 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948238+0000", 2024-09-16T04:08:21.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028249 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948339+0000", 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101152 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 34/31 ECSubWrite(tid=163, reqid=client.4631.0:38, at_version=34'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.952072+0000", 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0652488590000004, 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003854091, 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952072+0000", 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952072+0000", 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952074+0000", 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8029999999999999e-06 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952145+0000", 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1091000000000001e-05 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952174+0000", 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9561e-05 2024-09-16T04:08:21.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952196+0000", 2024-09-16T04:08:21.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1614999999999999e-05 2024-09-16T04:08:21.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952427+0000", 2024-09-16T04:08:21.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023104700000000001 2024-09-16T04:08:21.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952451+0000", 2024-09-16T04:08:21.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3941999999999999e-05 2024-09-16T04:08:21.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955823+0000", 2024-09-16T04:08:21.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033725080000000002 2024-09-16T04:08:21.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955926+0000", 2024-09-16T04:08:21.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102524 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 33/31 ECSubWrite(tid=6, reqid=client.4631.0:8, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.955994+0000", 2024-09-16T04:08:21.062 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0613268199999997, 2024-09-16T04:08:21.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052836640000000004, 2024-09-16T04:08:21.063 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955994+0000", 2024-09-16T04:08:21.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955994+0000", 2024-09-16T04:08:21.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955995+0000", 2024-09-16T04:08:21.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7e-06 2024-09-16T04:08:21.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956023+0000", 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7991e-05 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956053+0000", 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9954000000000002e-05 2024-09-16T04:08:21.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956075+0000", 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1809000000000001e-05 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957058+0000", 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00098243000000000007 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957081+0000", 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3368000000000001e-05 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961190+0000", 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041094829999999997 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961277+0000", 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6928999999999994e-05 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 34/31 ECSubWrite(tid=165, reqid=client.4631.0:43, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.958025+0000", 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0592960470000001, 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044909909999999997, 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958025+0000", 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958025+0000", 2024-09-16T04:08:21.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958026+0000", 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.877e-06 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958203+0000", 2024-09-16T04:08:21.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017646200000000001 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958238+0000", 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814000000000002e-05 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958263+0000", 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4854e-05 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958611+0000", 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034801400000000001 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958634+0000", 2024-09-16T04:08:21.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3184999999999999e-05 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.962431+0000", 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003796836 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.962516+0000", 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4949000000000003e-05 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 34/31 ECSubWrite(tid=166, reqid=client.4631.0:44, at_version=34'6, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.076 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.959833+0000", 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0574877750000002, 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048697590000000004, 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959833+0000", 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959833+0000", 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959834+0000", 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6199999999999999e-06 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959912+0000", 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7669999999999993e-05 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959944+0000", 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1878000000000002e-05 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959967+0000", 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2768e-05 2024-09-16T04:08:21.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960272+0000", 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030536099999999998 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960296+0000", 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3934000000000002e-05 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964577+0000", 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042813490000000003 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964703+0000", 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125179 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 34/31 ECSubWrite(tid=167, reqid=client.4631.0:26, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.960028+0000", 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0572922169999996, 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041126579999999999, 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960028+0000", 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960028+0000", 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960029+0000", 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9000000000000005e-07 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960049+0000", 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9728000000000002e-05 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960084+0000", 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4502999999999998e-05 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960102+0000", 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8732e-05 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960482+0000", 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038010499999999999 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960504+0000", 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1121999999999999e-05 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964041+0000", 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035378639999999999 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964141+0000", 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9613999999999999e-05 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=6, reqid=client.4631.0:40, at_version=34'3, trim_to=0'0, roll_forward_to=33'1))", 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.960404+0000", 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0569164530000004, 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00384147, 2024-09-16T04:08:21.087 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960404+0000", 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960404+0000", 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960416+0000", 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1809e-05 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960600+0000", 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000183752 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960627+0000", 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6985e-05 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960647+0000", 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0488000000000001e-05 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960820+0000", 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017242200000000001 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960844+0000", 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4411000000000001e-05 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964152+0000", 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033078249999999999 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964246+0000", 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3777999999999996e-05 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.092 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0412464540000004, 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064471959999999997, 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976076+0000", 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9429999999999999e-06 2024-09-16T04:08:21.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976477+0000", 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000400567 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976509+0000", 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2762999999999998e-05 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976533+0000", 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3167999999999999e-05 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976778+0000", 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245324 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976803+0000", 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4780999999999999e-05 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982391+0000", 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055884929999999999 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982521+0000", 2024-09-16T04:08:21.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013015699999999999 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0377230549999998, 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072774700000000003, 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979599+0000", 2024-09-16T04:08:21.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8530000000000001e-06 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979644+0000", 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4736e-05 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979677+0000", 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2681000000000001e-05 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979701+0000", 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3754999999999999e-05 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979867+0000", 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166689 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979890+0000", 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3264e-05 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986795+0000", 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069048069999999998 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986875+0000", 2024-09-16T04:08:21.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9684999999999993e-05 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0341306719999999, 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076880730000000001, 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.103 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:21.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983192+0000", 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983586+0000", 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039456700000000002 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983617+0000", 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0574000000000002e-05 2024-09-16T04:08:21.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983639+0000", 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2178999999999999e-05 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983866+0000", 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227366 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983888+0000", 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1804e-05 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990760+0000", 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068715030000000002 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990878+0000", 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011824600000000001 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.108 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=16, reqid=client.4631.0:56, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0323769609999998, 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064676780000000001, 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.109 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:21.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984946+0000", 2024-09-16T04:08:21.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-16T04:08:21.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984990+0000", 2024-09-16T04:08:21.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3776000000000002e-05 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985022+0000", 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2345999999999998e-05 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985043+0000", 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1549999999999999e-05 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985376+0000", 2024-09-16T04:08:21.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033260599999999999 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985400+0000", 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4015e-05 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991311+0000", 2024-09-16T04:08:21.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059112239999999996 2024-09-16T04:08:21.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991411+0000", 2024-09-16T04:08:21.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010003199999999999 2024-09-16T04:08:21.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.117 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds1 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0306943510000002, 2024-09-16T04:08:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059755490000000001, 2024-09-16T04:08:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:21.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986628+0000", 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.905e-06 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986905+0000", 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027719099999999998 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986953+0000", 2024-09-16T04:08:21.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8182e-05 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986976+0000", 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2997999999999999e-05 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987170+0000", 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193217 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987190+0000", 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0588999999999999e-05 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992498+0000", 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053074669999999997 2024-09-16T04:08:21.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992602+0000", 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010399999999999999 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=20, reqid=client.4631.0:56, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:21.124 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992315+0000", 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0250059279999997, 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045964700000000001, 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992315+0000", 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992315+0000", 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992316+0000", 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.792e-06 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992342+0000", 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5358e-05 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992534+0000", 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019200099999999999 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992560+0000", 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5935000000000002e-05 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992781+0000", 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022097499999999999 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992807+0000", 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6231999999999999e-05 2024-09-16T04:08:21.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996812+0000", 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040050600000000004 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996911+0000", 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9117000000000007e-05 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 34/31 ECSubWrite(tid=173, reqid=client.4631.0:83, at_version=34'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:17.000810+0000", 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0165103819999999, 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043774779999999998, 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.130 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000810+0000", 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000810+0000", 2024-09-16T04:08:21.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000812+0000", 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.544e-06 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000846+0000", 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3893000000000002e-05 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000870+0000", 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4323000000000001e-05 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000886+0000", 2024-09-16T04:08:21.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6359999999999999e-05 2024-09-16T04:08:21.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001042+0000", 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000155341 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001058+0000", 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6725e-05 2024-09-16T04:08:21.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.005127+0000", 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040683890000000004 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.005188+0000", 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0903000000000003e-05 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 34/31 ECSubWrite(tid=174, reqid=client.4631.0:83, at_version=0'0, trim_to=0'0, roll_forward_to=34'8))", 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:17.010071+0000", 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0072496089999996, 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037194340000000002, 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010071+0000", 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010071+0000", 2024-09-16T04:08:21.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010072+0000", 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3680000000000001e-06 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010092+0000", 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9632000000000001e-05 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010114+0000", 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1746000000000002e-05 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010151+0000", 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6900999999999998e-05 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011656+0000", 2024-09-16T04:08:21.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001505246 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011672+0000", 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.613e-05 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.013745+0000", 2024-09-16T04:08:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020728589999999998 2024-09-16T04:08:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.013790+0000", 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5552e-05 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.145 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:21.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:08:21.148 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:21.143+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:21.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:21.243+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:21.326 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:21.326 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:21.326 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:21.326 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:21.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:08:21.349 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:21.346+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:21.450 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:21.446+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:21.459 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:21.460 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:21.460 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:21.460 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:21.460 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:21.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:08:21.550 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:21.547+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:21.596 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:21.596 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as3 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.937327+0000", 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6563489589999998, 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076413640000000003, 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937327+0000", 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937327+0000", 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937329+0000", 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.903e-06 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937432+0000", 2024-09-16T04:08:21.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102612 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937465+0000", 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3380999999999998e-05 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937498+0000", 2024-09-16T04:08:21.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3186999999999999e-05 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937741+0000", 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024231 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937761+0000", 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944900+0000", 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071395089999999996 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944969+0000", 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8073999999999999e-05 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:34 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~196608,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:21.602 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6439288510000001, 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023419893000000001, 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 34 2024-09-16T04:08:21.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949751+0000", 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3790000000000002e-06 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951559+0000", 2024-09-16T04:08:21.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018085589999999999 2024-09-16T04:08:21.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951588+0000", 2024-09-16T04:08:21.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8728e-05 2024-09-16T04:08:21.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951607+0000", 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8817999999999998e-05 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951866+0000", 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025890800000000002 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952244+0000", 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378222 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.954553+0000", 2024-09-16T04:08:21.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023090099999999998 2024-09-16T04:08:21.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961470+0000", 2024-09-16T04:08:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069174079999999999 2024-09-16T04:08:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972971+0000", 2024-09-16T04:08:21.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011500923999999999 2024-09-16T04:08:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973167+0000", 2024-09-16T04:08:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195937 2024-09-16T04:08:21.611 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.612 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.612 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:35 3.cs0 3:3ee250f2:::smithi20431790-12:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:21.612 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6420185209999998, 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.029134334000000001, 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 35 2024-09-16T04:08:21.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951660+0000", 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.176e-06 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951673+0000", 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2799000000000001e-05 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951697+0000", 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4698e-05 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951715+0000", 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7265000000000002e-05 2024-09-16T04:08:21.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957234+0000", 2024-09-16T04:08:21.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055191260000000001 2024-09-16T04:08:21.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957565+0000", 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033102199999999999 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960023+0000", 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002458567 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.963486+0000", 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034622020000000002 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980404+0000", 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016918914 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980792+0000", 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038756499999999998 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:36 3.cs0 3:3ee250f2:::smithi20431790-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:08:21.620 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6419359550000001, 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.045222315999999999, 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.622 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 36 2024-09-16T04:08:21.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.622 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:08:21.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:08:21.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951742+0000", 2024-09-16T04:08:21.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-16T04:08:21.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951749+0000", 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7190000000000001e-06 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951770+0000", 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0092e-05 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951785+0000", 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5162e-05 2024-09-16T04:08:21.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961177+0000", 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093920979999999998 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961445+0000", 2024-09-16T04:08:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268664 2024-09-16T04:08:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981947+0000", 2024-09-16T04:08:21.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020501287999999999 2024-09-16T04:08:21.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982122+0000", 2024-09-16T04:08:21.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017487899999999999 2024-09-16T04:08:21.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996963+0000", 2024-09-16T04:08:21.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014840901 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.9s4 34/31 ECSubWrite(tid=1, reqid=client.4631.0:32, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.952027+0000", 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6416488860000005, 2024-09-16T04:08:21.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089146710000000007, 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952027+0000", 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952027+0000", 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952036+0000", 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8259999999999999e-06 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952070+0000", 2024-09-16T04:08:21.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3451000000000002e-05 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952094+0000", 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4131e-05 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952113+0000", 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9134999999999999e-05 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.954913+0000", 2024-09-16T04:08:21.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00280058 2024-09-16T04:08:21.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.954990+0000", 2024-09-16T04:08:21.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6429999999999998e-05 2024-09-16T04:08:21.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960873+0000", 2024-09-16T04:08:21.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005883241 2024-09-16T04:08:21.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960942+0000", 2024-09-16T04:08:21.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8876999999999998e-05 2024-09-16T04:08:21.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:49 3.5s0 3:a07911e0:::smithi20431790-17:head [append 0~278528,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6292619589999999, 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017107101999999999, 2024-09-16T04:08:21.638 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.639 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.639 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.639 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.639 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 49 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964417+0000", 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0529999999999998e-06 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964962+0000", 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054521099999999998 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964997+0000", 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4028e-05 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965020+0000", 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3553999999999998e-05 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965225+0000", 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020534700000000001 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965562+0000", 2024-09-16T04:08:21.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000336332 2024-09-16T04:08:21.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967943+0000", 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023810950000000002 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971887+0000", 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039443120000000002 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981336+0000", 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0094491490000000004 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981521+0000", 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000185021 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.646 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:50 3.5s0 3:a07911e0:::smithi20431790-17:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6285751660000001, 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018470364999999999, 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 50 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.647 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965103+0000", 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965114+0000", 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1616e-05 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965139+0000", 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4711000000000001e-05 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965158+0000", 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8774999999999999e-05 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969089+0000", 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039314490000000001 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969306+0000", 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021679300000000001 2024-09-16T04:08:21.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.970337+0000", 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001030385 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974758+0000", 2024-09-16T04:08:21.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044213810000000003 2024-09-16T04:08:21.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983346+0000", 2024-09-16T04:08:21.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085879849999999994 2024-09-16T04:08:21.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983571+0000", 2024-09-16T04:08:21.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225427 2024-09-16T04:08:21.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.654 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.654 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.654 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:51 3.5s0 3:a07911e0:::smithi20431790-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.654 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:08:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6284816009999998, 2024-09-16T04:08:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022912589000000001, 2024-09-16T04:08:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:21.655 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 51 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965196+0000", 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5e-06 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965204+0000", 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965227+0000", 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2751e-05 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965247+0000", 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0404999999999999e-05 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971064+0000", 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058171619999999999 2024-09-16T04:08:21.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971306+0000", 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024202800000000001 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984390+0000", 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013083734 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984580+0000", 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000190101 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988107+0000", 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035270050000000002 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.661 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as3 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979874+0000", 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.613801874, 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012428402999999999, 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.662 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979874+0000", 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979874+0000", 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979876+0000", 2024-09-16T04:08:21.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.314e-06 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980110+0000", 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023470300000000001 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980162+0000", 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2024000000000002e-05 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980183+0000", 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1146999999999999e-05 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980602+0000", 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00041848200000000002 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980641+0000", 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8587999999999997e-05 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992205+0000", 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011564293999999999 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992303+0000", 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7850999999999995e-05 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as3 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.980238+0000", 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.613437953, 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012131830999999999, 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980238+0000", 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980238+0000", 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980239+0000", 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.122e-06 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980271+0000", 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2091999999999997e-05 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980294+0000", 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2818000000000001e-05 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980333+0000", 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8303000000000002e-05 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983299+0000", 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029668939999999999 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983321+0000", 2024-09-16T04:08:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1427e-05 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992317+0000", 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089963850000000008 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992370+0000", 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2790000000000001e-05 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:70 3.cs0 3:32f692e4:::smithi20431790-24:head [append 0~393216,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6092068680000002, 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022625648000000002, 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.672 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 70 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:08:21.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984472+0000", 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5770000000000001e-06 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985137+0000", 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066504699999999999 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985170+0000", 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2877999999999999e-05 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985193+0000", 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3014999999999999e-05 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988812+0000", 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003619583 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989134+0000", 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000321496 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992649+0000", 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003514994 2024-09-16T04:08:21.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997670+0000", 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050209540000000002 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006922+0000", 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092525839999999995 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007095+0000", 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017252000000000001 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.678 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:71 3.cs0 3:32f692e4:::smithi20431790-24:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.608446314, 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024343912999999998, 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.679 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 71 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985232+0000", 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7710000000000001e-06 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985241+0000", 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985269+0000", 2024-09-16T04:08:21.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7426000000000001e-05 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985286+0000", 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994404+0000", 2024-09-16T04:08:21.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.009118279 2024-09-16T04:08:21.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994605+0000", 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020087800000000001 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995926+0000", 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013212320000000001 2024-09-16T04:08:21.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998575+0000", 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026493300000000001 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009408+0000", 2024-09-16T04:08:21.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010832965999999999 2024-09-16T04:08:21.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009574+0000", 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165487 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.689 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:72 3.cs0 3:32f692e4:::smithi20431790-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6083661720000002, 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030489715000000001, 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:21.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 72 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985311+0000", 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.234e-06 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985319+0000", 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8110000000000003e-06 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985338+0000", 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9372e-05 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985354+0000", 2024-09-16T04:08:21.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997327+0000", 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011973477999999999 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:21.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997539+0000", 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021212 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010366+0000", 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012826743 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010517+0000", 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150987 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015800+0000", 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052827170000000001 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 34/31 ECSubWriteReply(tid=4, last_complete=34'2, committed=1, applied=1))", 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.988815+0000", 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6048612069999999, 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076121410000000002, 2024-09-16T04:08:21.697 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988815+0000", 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988815+0000", 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988816+0000", 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.077e-06 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988823+0000", 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.216e-06 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988845+0000", 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1959000000000001e-05 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988860+0000", 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4392999999999999e-05 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996385+0000", 2024-09-16T04:08:21.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075257060000000001 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996427+0000", 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1789999999999998e-05 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:79 3.5s0 3:a92fec0c:::smithi20431790-27:head [append 0~442368,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.6004584839999998, 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022443769999999998, 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 79 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993221+0000", 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1939999999999998e-06 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994063+0000", 2024-09-16T04:08:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000842401 2024-09-16T04:08:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994096+0000", 2024-09-16T04:08:21.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2977e-05 2024-09-16T04:08:21.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994117+0000", 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0632000000000002e-05 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994356+0000", 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023911000000000001 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994668+0000", 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031195700000000002 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998787+0000", 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041189850000000004 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004001+0000", 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052138510000000002 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015531+0000", 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011530004 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015661+0000", 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013065900000000001 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:80 3.5s0 3:a92fec0c:::smithi20431790-27:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.599503661, 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022213561999999999, 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 80 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994174+0000", 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6190000000000001e-06 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994185+0000", 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1014e-05 2024-09-16T04:08:21.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994208+0000", 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2677999999999999e-05 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994225+0000", 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7238e-05 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001985+0000", 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077595709999999998 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002157+0000", 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017256300000000001 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:21.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003005+0000", 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084732500000000001 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004682+0000", 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016769899999999999 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016279+0000", 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011597303 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016386+0000", 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107261 2024-09-16T04:08:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:81 3.5s0 3:a92fec0c:::smithi20431790-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.599188474, 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025428882, 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.717 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 81 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994490+0000", 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994499+0000", 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6420000000000002e-06 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994529+0000", 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9405999999999999e-05 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994548+0000", 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9884000000000001e-05 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004211+0000", 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0096627850000000001 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004368+0000", 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015635099999999999 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016915+0000", 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012547063000000001 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.017089+0000", 2024-09-16T04:08:21.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017398399999999999 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.019917+0000", 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028279239999999999 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.723 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 34/31 ECSubWriteReply(tid=6, last_complete=34'2, committed=1, applied=1))", 2024-09-16T04:08:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.996302+0000", 2024-09-16T04:08:21.724 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5973742419999999, 2024-09-16T04:08:21.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076101750000000003, 2024-09-16T04:08:21.725 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:21.725 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996302+0000", 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996302+0000", 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996303+0000", 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1969999999999999e-06 2024-09-16T04:08:21.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996312+0000", 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2019999999999993e-06 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996334+0000", 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1948999999999999e-05 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996350+0000", 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5758999999999999e-05 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003774+0000", 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074240319999999997 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003912+0000", 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013803599999999999 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:114 3.5s0 3:a7670964:::smithi20431790-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:17.035640+0000", 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5580361580000002, 2024-09-16T04:08:21.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071348219999999999, 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 114 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.035640+0000", 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.035640+0000", 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.035641+0000", 2024-09-16T04:08:21.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9400000000000004e-07 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.035646+0000", 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.831e-06 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.035657+0000", 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1694e-05 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.035667+0000", 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9029999999999999e-06 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.039571+0000", 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003903293 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.039700+0000", 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012925799999999999 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.041227+0000", 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015270100000000001 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.041336+0000", 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010933 2024-09-16T04:08:21.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.042775+0000", 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001438609 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:145 3.5s0 3:a0d22ea8:::smithi20431790-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:17.081684+0000", 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5119917530000002, 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0082478989999999995, 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:21.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:21.738 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:21.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 145 2024-09-16T04:08:21.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.738 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:21.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.081684+0000", 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.081684+0000", 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.081685+0000", 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6000000000000003e-07 2024-09-16T04:08:21.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.081688+0000", 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2969999999999999e-06 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.081697+0000", 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3059999999999998e-06 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.081704+0000", 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9999999999999999e-06 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.085119+0000", 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003415225 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.085208+0000", 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8659000000000006e-05 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.087778+0000", 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025706100000000001 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.087909+0000", 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000130529 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.089932+0000", 2024-09-16T04:08:21.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020235129999999998 2024-09-16T04:08:21.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:21.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:21.743 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:21.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:08:21.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:21.743+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:21.845 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:21.840+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:21.876 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:21.877 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:21.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:08:21.946 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:21.944+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:21.971 INFO:tasks.rados.rados.0.smithi204.stdout:67: done (0 left) 2024-09-16T04:08:21.971 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 37 current snap is 4 2024-09-16T04:08:21.971 INFO:tasks.rados.rados.0.smithi204.stdout:68: seq_num 57 ranges {606208=589824,1196032=376832} 2024-09-16T04:08:21.989 INFO:tasks.rados.rados.0.smithi204.stdout:68: writing smithi20431790-37 from 606208 to 1196032 tid 1 2024-09-16T04:08:21.995 INFO:tasks.rados.rados.0.smithi204.stdout:68: writing smithi20431790-37 from 1196032 to 1572864 tid 2 2024-09-16T04:08:21.995 INFO:tasks.rados.rados.0.smithi204.stdout:69: snap_remove snap 2 2024-09-16T04:08:22.021 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:22.021 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:22.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:08:22.047 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:22.042+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:22.148 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:22.145+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:22.161 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2207139390000004, 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063652539999999999, 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:08:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938469+0000", 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2699999999999998e-07 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938635+0000", 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016581300000000001 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938684+0000", 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9576000000000001e-05 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938883+0000", 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000199173 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939095+0000", 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000211246 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939119+0000", 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4357000000000001e-05 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944738+0000", 2024-09-16T04:08:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056193900000000001 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944833+0000", 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4871999999999996e-05 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2201746169999996, 2024-09-16T04:08:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047666380000000001, 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939008+0000", 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.13e-07 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939093+0000", 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5012999999999994e-05 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939129+0000", 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5636999999999998e-05 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939152+0000", 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3745000000000001e-05 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939447+0000", 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029490799999999998 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939469+0000", 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1848000000000002e-05 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943713+0000", 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042438789999999999 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943774+0000", 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0995000000000001e-05 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2200946339999996, 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058140029999999999, 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939089+0000", 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5570000000000001e-06 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939159+0000", 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0069999999999998e-05 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939189+0000", 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9971000000000002e-05 2024-09-16T04:08:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939212+0000", 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3088999999999999e-05 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941350+0000", 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021383169999999998 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941374+0000", 2024-09-16T04:08:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3742000000000001e-05 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944842+0000", 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034683349999999999 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944901+0000", 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8922000000000003e-05 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2170344970000002, 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050280460000000004, 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942149+0000", 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-06 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942191+0000", 2024-09-16T04:08:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1461999999999997e-05 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942224+0000", 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3181e-05 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942254+0000", 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0151e-05 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942467+0000", 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212862 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942490+0000", 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3227999999999999e-05 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947072+0000", 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00458203 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947176+0000", 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010343799999999999 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=6, reqid=client.4631.0:8, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.955466+0000", 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2037164169999999, 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003956935, 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955466+0000", 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955466+0000", 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955466+0000", 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9999999999999997e-07 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955499+0000", 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3059999999999999e-05 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955543+0000", 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3585999999999999e-05 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955568+0000", 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4851e-05 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955924+0000", 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035640999999999998 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.955995+0000", 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1211000000000006e-05 2024-09-16T04:08:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959330+0000", 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033343610000000001 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959423+0000", 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2756000000000004e-05 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=2, reqid=client.4631.0:17, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.956637+0000", 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2025447549999999, 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00353024, 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956637+0000", 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956637+0000", 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956639+0000", 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0320000000000002e-06 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956669+0000", 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9575000000000001e-05 2024-09-16T04:08:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956701+0000", 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2212999999999998e-05 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956724+0000", 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2561999999999998e-05 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956953+0000", 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022890700000000001 2024-09-16T04:08:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956977+0000", 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4882e-05 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960078+0000", 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031003799999999998 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960167+0000", 2024-09-16T04:08:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9689000000000001e-05 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=2, reqid=client.4631.0:49, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.967594+0000", 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1915877999999998, 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046403140000000004, 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967594+0000", 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967594+0000", 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967595+0000", 2024-09-16T04:08:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967979+0000", 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038433800000000002 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968297+0000", 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031739700000000002 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968329+0000", 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2724e-05 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968501+0000", 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017191600000000001 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968523+0000", 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2211000000000001e-05 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972141+0000", 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036174800000000002 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972235+0000", 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3554999999999995e-05 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=4, reqid=client.4631.0:52, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.968600+0000", 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1905818310000003, 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043334439999999997, 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968600+0000", 2024-09-16T04:08:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968600+0000", 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968602+0000", 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0099999999999998e-06 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968790+0000", 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000187944 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968824+0000", 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3884000000000003e-05 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968848+0000", 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4000999999999999e-05 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969085+0000", 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023667100000000001 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969110+0000", 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5361e-05 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972839+0000", 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037292139999999998 2024-09-16T04:08:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972934+0000", 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4358999999999996e-05 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=5, reqid=client.4631.0:53, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.969197+0000", 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1899852150000001, 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038087450000000001, 2024-09-16T04:08:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969197+0000", 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969197+0000", 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969199+0000", 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9139999999999998e-06 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969240+0000", 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1307999999999998e-05 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969272+0000", 2024-09-16T04:08:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.222e-05 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969293+0000", 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1024000000000001e-05 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.970581+0000", 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001288109 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.970605+0000", 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3340999999999999e-05 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972950+0000", 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023448539999999999 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973006+0000", 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5974999999999999e-05 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976401+0000", 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1827812719999997, 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046894420000000003, 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976401+0000", 2024-09-16T04:08:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976401+0000", 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976403+0000", 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9709999999999998e-06 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976629+0000", 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022586399999999999 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976661+0000", 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2796999999999998e-05 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976683+0000", 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1219000000000001e-05 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976817+0000", 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013438 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976840+0000", 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2789000000000002e-05 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980995+0000", 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00415527 2024-09-16T04:08:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981090+0000", 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5152e-05 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=8, reqid=client.4631.0:61, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1817196919999997, 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063833630000000004, 2024-09-16T04:08:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977464+0000", 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.531e-06 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977708+0000", 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024464000000000002 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977740+0000", 2024-09-16T04:08:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1711000000000002e-05 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977762+0000", 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399e-05 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977934+0000", 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000172654 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977956+0000", 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1435000000000001e-05 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983751+0000", 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057949120000000002 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983846+0000", 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5081000000000007e-05 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=9, reqid=client.4631.0:62, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.180929581, 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056761249999999997, 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:08:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978254+0000", 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.488e-06 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978292+0000", 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7880000000000003e-05 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978321+0000", 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9023e-05 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978340+0000", 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9524000000000001e-05 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979207+0000", 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00086708800000000002 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979243+0000", 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5457000000000003e-05 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983860+0000", 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046170930000000001 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983929+0000", 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8571999999999993e-05 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979700+0000", 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1794824760000004, 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040005680000000004, 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979700+0000", 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979700+0000", 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979701+0000", 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.722e-06 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979744+0000", 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3077000000000001e-05 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979775+0000", 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1000000000000001e-05 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979796+0000", 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0543999999999998e-05 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980018+0000", 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022211 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980041+0000", 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2855000000000001e-05 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983597+0000", 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035560829999999998 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983700+0000", 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010317700000000001 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=6, reqid=client.4631.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1751537790000004, 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011901461, 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984031+0000", 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3429999999999998e-06 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984058+0000", 2024-09-16T04:08:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7029000000000002e-05 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984089+0000", 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1016999999999998e-05 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984109+0000", 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0842000000000001e-05 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984406+0000", 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029609200000000002 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984434+0000", 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8918e-05 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995793+0000", 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011358052 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995930+0000", 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013716800000000001 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1727635269999999, 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095992419999999992, 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986420+0000", 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.934e-06 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987321+0000", 2024-09-16T04:08:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090024099999999998 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987354+0000", 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3154999999999997e-05 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987376+0000", 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1923999999999999e-05 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987514+0000", 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013814799999999999 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987534+0000", 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9873000000000001e-05 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995938+0000", 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084043529999999998 2024-09-16T04:08:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996018+0000", 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9614e-05 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1691360570000002, 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059765189999999996, 2024-09-16T04:08:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990048+0000", 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8509999999999999e-06 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990075+0000", 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7158e-05 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990106+0000", 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1080000000000001e-05 2024-09-16T04:08:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990136+0000", 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9901000000000001e-05 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990290+0000", 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015433800000000001 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990314+0000", 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3421000000000002e-05 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995910+0000", 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055967500000000002 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996022+0000", 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011202 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 34/31 ECSubWrite(tid=14, reqid=client.4631.0:68, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992455+0000", 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1667270639999998, 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044737860000000004, 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992455+0000", 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992455+0000", 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992457+0000", 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.885e-06 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992512+0000", 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5535999999999998e-05 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992570+0000", 2024-09-16T04:08:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7886000000000001e-05 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992600+0000", 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9889000000000001e-05 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992769+0000", 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000169116 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992792+0000", 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2484e-05 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996824+0000", 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004032384 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996929+0000", 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010460599999999999 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992655+0000", 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.166527104, 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043788179999999996, 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992655+0000", 2024-09-16T04:08:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992655+0000", 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992656+0000", 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7699999999999992e-07 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993378+0000", 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072215699999999996 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993408+0000", 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0297000000000001e-05 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993428+0000", 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0092999999999999e-05 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993637+0000", 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020855799999999999 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993681+0000", 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4058999999999999e-05 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996938+0000", 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032569370000000001 2024-09-16T04:08:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997034+0000", 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5740000000000002e-05 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=10, reqid=client.4631.0:79, at_version=34'3, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.998890+0000", 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1602915009999997, 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041317749999999999, 2024-09-16T04:08:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998890+0000", 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998890+0000", 2024-09-16T04:08:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998892+0000", 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9709999999999998e-06 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.999150+0000", 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025734500000000002 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.999188+0000", 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7774000000000001e-05 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.999209+0000", 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1409000000000001e-05 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000095+0000", 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00088598599999999996 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.000123+0000", 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7586e-05 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002918+0000", 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027956679999999999 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003022+0000", 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104036 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 38/31 ECSubWrite(tid=32, reqid=client.4631.0:186, at_version=38'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.185254357, 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048151569999999996, 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6599999999999996e-07 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973995+0000", 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6209000000000003e-05 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974069+0000", 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4597000000000004e-05 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974094+0000", 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4532000000000002e-05 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974684+0000", 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058996600000000004 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974697+0000", 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3689000000000001e-05 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.977292+0000", 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025942180000000001 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.978743+0000", 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014512800000000001 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.253 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:22.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:08:22.255 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:22.253+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:22.356 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:22.354+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:22.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:22.432 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:22.432 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:22.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:08:22.494 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:22.493+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:22.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:22.555+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:22.574 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:22.574 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:22.575 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:22.575 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:22.589 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:08:22.591 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:22.591 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:22.609 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:22.629 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:22.630 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:22.651 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:22.651 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:22.658 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:22.655+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:22.667 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:22.668 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:22.686 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:22.686 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:22.707 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:22.707 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:22.729 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:22.749 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:22.750 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:22.759 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:22.756+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:22.761 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:7 3.as0 3:52d8912d:::smithi20431790-3:head [append 0~49152,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.933734+0000", 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8247119060000001, 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015483771, 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.762 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.933734+0000", 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.933734+0000", 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.933737+0000", 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.937e-06 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.933932+0000", 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195556 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.933963+0000", 2024-09-16T04:08:22.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0365000000000002e-05 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.933980+0000", 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7685000000000001e-05 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934190+0000", 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020923200000000001 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934516+0000", 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032660300000000002 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936941+0000", 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024244010000000001 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948807+0000", 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011865946 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949001+0000", 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019485999999999999 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949218+0000", 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021618599999999999 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.767 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:8 3.as0 3:52d8912d:::smithi20431790-3:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934014+0000", 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8244321589999997, 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017053859000000001, 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 8 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934014+0000", 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934014+0000", 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.626e-06 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934026+0000", 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0482999999999999e-05 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934047+0000", 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1375000000000001e-05 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934065+0000", 2024-09-16T04:08:22.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7640999999999999e-05 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937962+0000", 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038972210000000002 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938198+0000", 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023572999999999999 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940446+0000", 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022479750000000001 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949229+0000", 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087831780000000009 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949384+0000", 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000155604 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951067+0000", 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001683026 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:9 3.as0 3:52d8912d:::smithi20431790-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.824354553, 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.032735913999999998, 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 9 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934092+0000", 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3170000000000001e-06 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934099+0000", 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.37e-06 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934121+0000", 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2124999999999999e-05 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934137+0000", 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6464999999999999e-05 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941032+0000", 2024-09-16T04:08:22.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068944719999999996 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941265+0000", 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233105 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952818+0000", 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011552529000000001 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.953039+0000", 2024-09-16T04:08:22.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221089 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.966827+0000", 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013788442 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s2 33/31 ECSubWrite(tid=158, reqid=client.4631.0:10, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.935351+0000", 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8230948109999998, 2024-09-16T04:08:22.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016703684999999999, 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935351+0000", 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935351+0000", 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935352+0000", 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0299999999999998e-07 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935453+0000", 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101402 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935488+0000", 2024-09-16T04:08:22.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5110000000000001e-05 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935512+0000", 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3671000000000001e-05 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941368+0000", 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058558430000000003 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941388+0000", 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0528999999999999e-05 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951977+0000", 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010588433 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952055+0000", 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7993999999999999e-05 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s2 33/31 ECSubWrite(tid=159, reqid=client.4631.0:11, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936567+0000", 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.82187857, 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015551924999999999, 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936567+0000", 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936567+0000", 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936569+0000", 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936608+0000", 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9854000000000002e-05 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936636+0000", 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7334e-05 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936662+0000", 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6647000000000001e-05 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942837+0000", 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061744030000000002 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942860+0000", 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3487999999999999e-05 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952062+0000", 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092018169999999993 2024-09-16T04:08:22.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952119+0000", 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6885000000000002e-05 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:19 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~114688,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8210674510000002, 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019793136999999999, 2024-09-16T04:08:22.787 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 19 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.788 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937381+0000", 2024-09-16T04:08:22.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.633e-06 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937660+0000", 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027928000000000002 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5524000000000001e-05 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937718+0000", 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2602000000000001e-05 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937890+0000", 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017148200000000001 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938217+0000", 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032706899999999998 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940124+0000", 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001907143 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948870+0000", 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087458320000000003 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956986+0000", 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0081158810000000001 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957171+0000", 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018569100000000001 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:20 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.819843906, 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020600382, 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 20 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938604+0000", 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9659999999999999e-06 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938616+0000", 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1992e-05 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938643+0000", 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7447999999999999e-05 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9269000000000001e-05 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941338+0000", 2024-09-16T04:08:22.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002675242 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941576+0000", 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023854 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943570+0000", 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019934800000000002 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949041+0000", 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005471722 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958969+0000", 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099272460000000007 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959202+0000", 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233477 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:21 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8197359649999996, 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028407564999999999, 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 21 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938711+0000", 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4330000000000001e-06 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938719+0000", 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3189999999999995e-06 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938743+0000", 2024-09-16T04:08:22.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3645000000000001e-05 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938782+0000", 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9013000000000001e-05 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944592+0000", 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005810267 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:22.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944817+0000", 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000224904 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960092+0000", 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015274846 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960315+0000", 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223095 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967117+0000", 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068020429999999998 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s2 34/31 ECSubWrite(tid=170, reqid=client.4631.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7868966909999999, 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020104377, 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971551+0000", 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6169999999999999e-06 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971575+0000", 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3878000000000001e-05 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971623+0000", 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8494e-05 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971641+0000", 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7944e-05 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971835+0000", 2024-09-16T04:08:22.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019388000000000001 2024-09-16T04:08:22.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971861+0000", 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6508000000000001e-05 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991592+0000", 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019731027000000002 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991653+0000", 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1029000000000001e-05 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:58 3.as0 3:57bc9072:::smithi20431790-20:head [append 0~327680,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7857333659999997, 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023641881999999999, 2024-09-16T04:08:22.810 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 58 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972715+0000", 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1310000000000002e-06 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973401+0000", 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068536200000000002 2024-09-16T04:08:22.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973436+0000", 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4777000000000003e-05 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973457+0000", 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1047e-05 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973758+0000", 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000301716 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974093+0000", 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033437899999999999 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976226+0000", 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021329019999999999 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991758+0000", 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015532035 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044259850000000003 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996354+0000", 2024-09-16T04:08:22.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017054799999999999 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:59 3.as0 3:57bc9072:::smithi20431790-20:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.784937416, 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023229295, 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 59 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973510+0000", 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973519+0000", 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9449999999999999e-06 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973678+0000", 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158815 2024-09-16T04:08:22.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973702+0000", 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.461e-05 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977799+0000", 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040967520000000004 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978040+0000", 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024069299999999999 2024-09-16T04:08:22.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979318+0000", 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001278164 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991761+0000", 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012442844999999999 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996561+0000", 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048005419999999997 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996738+0000", 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017617199999999999 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:60 3.as0 3:57bc9072:::smithi20431790-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:22.821 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7847117519999998, 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034426401000000002, 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 60 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973736+0000", 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-06 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973746+0000", 2024-09-16T04:08:22.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0056e-05 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973770+0000", 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3966999999999999e-05 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973785+0000", 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5512999999999999e-05 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979953+0000", 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061678890000000002 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980244+0000", 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029044900000000002 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996914+0000", 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016670404999999999 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997079+0000", 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165126 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008160+0000", 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011081036000000001 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.826 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:64 3.as0 3:5581c6e4:::smithi20431790-22:head [append 0~360448,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7799909239999998, 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024425922999999999, 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 64 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978458+0000", 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7429999999999998e-06 2024-09-16T04:08:22.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979197+0000", 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073908700000000003 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979227+0000", 2024-09-16T04:08:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0793999999999997e-05 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979247+0000", 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0078999999999999e-05 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980478+0000", 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012303170000000001 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981002+0000", 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052460899999999999 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990256+0000", 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092540160000000003 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002501+0000", 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012244649 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002743+0000", 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024201600000000001 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002881+0000", 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137613 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:65 3.as0 3:5581c6e4:::smithi20431790-22:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.832 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.779163187, 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027732105, 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 65 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979284+0000", 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.711e-06 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979382+0000", 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8177999999999994e-05 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979409+0000", 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6435e-05 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979459+0000", 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0192999999999999e-05 2024-09-16T04:08:22.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993281+0000", 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013822302 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993476+0000", 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019474100000000001 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994583+0000", 2024-09-16T04:08:22.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001106473 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003469+0000", 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088860840000000007 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006865+0000", 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033959749999999999 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007015+0000", 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150013 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:66 3.as0 3:5581c6e4:::smithi20431790-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7789584529999996, 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.035359943999999997, 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:22.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 66 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979489+0000", 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5999999999999999e-06 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979496+0000", 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0820000000000001e-06 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979516+0000", 2024-09-16T04:08:22.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9779000000000002e-05 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979530+0000", 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4198e-05 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994979+0000", 2024-09-16T04:08:22.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015449176 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995185+0000", 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000206391 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008423+0000", 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013237844 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008619+0000", 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195582 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.014847+0000", 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062282919999999999 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:67 3.ds0 3:bc48267e:::smithi20431790-23:head [append 0~376832,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:22.843 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7766708390000003, 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020232841000000001, 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 67 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981785+0000", 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982754+0000", 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096953899999999995 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982787+0000", 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3216999999999997e-05 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982807+0000", 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9304e-05 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983165+0000", 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035800399999999998 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983490+0000", 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032504399999999997 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985908+0000", 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024180780000000002 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994386+0000", 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084781360000000007 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001861+0000", 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074755220000000001 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002008+0000", 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014632299999999999 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.848 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:68 3.ds0 3:bc48267e:::smithi20431790-23:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982856+0000", 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7755897950000001, 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019565196999999999, 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 68 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982856+0000", 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982856+0000", 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982858+0000", 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.663e-06 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982867+0000", 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7880000000000001e-06 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982891+0000", 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3232000000000001e-05 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982907+0000", 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6744000000000001e-05 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988117+0000", 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052098810000000004 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988339+0000", 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022159299999999999 2024-09-16T04:08:22.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989503+0000", 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011639630000000001 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994392+0000", 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048887849999999997 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002254+0000", 2024-09-16T04:08:22.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078621869999999996 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002421+0000", 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016736100000000001 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:69 3.ds0 3:bc48267e:::smithi20431790-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7754994709999998, 2024-09-16T04:08:22.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028842145999999999, 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 69 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982948+0000", 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-06 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982989+0000", 2024-09-16T04:08:22.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1464999999999997e-05 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983013+0000", 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3703999999999999e-05 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983029+0000", 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5843999999999999e-05 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990775+0000", 2024-09-16T04:08:22.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077465149999999998 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991025+0000", 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024982599999999998 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003046+0000", 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012021118000000001 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003451+0000", 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040476500000000002 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011788+0000", 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008337555 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:73 3.fs0 3:f2191a5d:::smithi20431790-25:head [append 0~409600,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.859 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.987622+0000", 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7708235449999998, 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018055873, 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 73 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987622+0000", 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987622+0000", 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987625+0000", 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5790000000000002e-06 2024-09-16T04:08:22.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988560+0000", 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093503900000000003 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988593+0000", 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3297999999999999e-05 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988613+0000", 2024-09-16T04:08:22.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0143999999999999e-05 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988817+0000", 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000203957 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989141+0000", 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032344999999999997 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991388+0000", 2024-09-16T04:08:22.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022469199999999999 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001889+0000", 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010501719 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.005546+0000", 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003656294 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.005678+0000", 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132473 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:75 3.fs0 3:f2191a5d:::smithi20431790-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7663040209999998, 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019651762999999999, 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:22.865 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 75 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:22.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992143+0000", 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992149+0000", 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1449999999999996e-06 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992169+0000", 2024-09-16T04:08:22.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0169999999999998e-05 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992184+0000", 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4389999999999999e-05 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994919+0000", 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002735754 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:22.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995184+0000", 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000264481 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006682+0000", 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011498441999999999 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006786+0000", 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010324500000000001 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:22.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011793+0000", 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005007933 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:22.870 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:22.871 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:22.871 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:22.872 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:22.872 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:22.872 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:08:22.873 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:22.873 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:22.874 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:22.874 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:22.874 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:22.874 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:22.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:22.867+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:22.884 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:22.884 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:22.906+0000 7ff60e90b640 0 -- 172.21.15.32:0/3081235679 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7ff608225f10 msgr2=0x7ff608228300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:22.910 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:22.972 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:22.969+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:69: done (1 left) 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:70: copy_from oid 30 from oid 17 current snap is 4 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:68: finishing write tid 1 to smithi20431790-37 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:68: finishing write tid 2 to smithi20431790-37 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:68: finishing write tid 3 to smithi20431790-37 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:68: finishing write tid 4 to smithi20431790-37 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:68: oid 37 updating version 0 to 7 2024-09-16T04:08:22.991 INFO:tasks.rados.rados.0.smithi204.stdout:68: oid 37 updating version 7 to 8 2024-09-16T04:08:22.992 INFO:tasks.rados.rados.0.smithi204.stdout:68: oid 37 version 8 is already newer than 6 2024-09-16T04:08:22.992 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 37 v 8 (ObjNum 57 snap 4 seq_num 57) dirty exists 2024-09-16T04:08:22.992 INFO:tasks.rados.rados.0.smithi204.stdout:68: left oid 37 (ObjNum 57 snap 4 seq_num 57) 2024-09-16T04:08:22.992 INFO:tasks.rados.rados.0.smithi204.stdout:68: done (1 left) 2024-09-16T04:08:22.992 INFO:tasks.rados.rados.0.smithi204.stdout:71: delete oid 42 current snap is 4 2024-09-16T04:08:22.992 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-16T04:08:23.007 INFO:tasks.rados.rados.0.smithi204.stdout:70: finishing copy_from racing read to smithi20431790-30 2024-09-16T04:08:23.008 INFO:tasks.rados.rados.0.smithi204.stdout:71: done (1 left) 2024-09-16T04:08:23.008 INFO:tasks.rados.rados.0.smithi204.stdout:72: setattr oid 49 current snap is 4 2024-09-16T04:08:23.010 INFO:tasks.rados.rados.0.smithi204.stdout:70: finishing copy_from to smithi20431790-30 2024-09-16T04:08:23.010 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-16T04:08:23.015 INFO:tasks.rados.rados.0.smithi204.stdout:70: done (1 left) 2024-09-16T04:08:23.015 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 46 current snap is 4 2024-09-16T04:08:23.015 INFO:tasks.rados.rados.0.smithi204.stdout:73: seq_num 59 ranges {770048=622592,1392640=376832} 2024-09-16T04:08:23.016 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.016 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.033 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:08:23.038 INFO:tasks.rados.rados.0.smithi204.stdout:73: writing smithi20431790-46 from 770048 to 1392640 tid 1 2024-09-16T04:08:23.044 INFO:tasks.rados.rados.0.smithi204.stdout:73: writing smithi20431790-46 from 1392640 to 1769472 tid 2 2024-09-16T04:08:23.045 INFO:tasks.rados.rados.0.smithi204.stdout:74: snap_remove snap 0 2024-09-16T04:08:23.077 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:23.075+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:23.152 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.153 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.169 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:08:23.174 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:23.173+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:23.275 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:23.272+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:23.334 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.335 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.349 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:08:23.376 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:23.373+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:23.472 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.473 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.477 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:23.473+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:23.486 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:08:23.578 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:23.574+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:23.609 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.609 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:08:23.646 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:08:23.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T04:08:23.679 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:23.677+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:23.747 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.747 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.761 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:08:23.805 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:23.803+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:23.881 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:23.881 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:23.881 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:23.876+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:23.895 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:08:23.982 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:23.980+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:23.992 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-16T04:08:23.992 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 20 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: finishing write tid 1 to smithi20431790-46 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: finishing write tid 2 to smithi20431790-46 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: finishing write tid 3 to smithi20431790-46 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: finishing write tid 4 to smithi20431790-46 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: oid 46 updating version 0 to 8 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: oid 46 updating version 8 to 9 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:73: oid 46 updating version 9 to 10 2024-09-16T04:08:23.996 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 46 v 10 (ObjNum 59 snap 4 seq_num 59) dirty exists 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:73: left oid 46 (ObjNum 59 snap 4 seq_num 59) 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:72: done (2 left) 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:73: done (1 left) 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:74: done (0 left) 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:75: read oid 40 snap -1 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:75: expect (ObjNum 39 snap 0 seq_num 39) 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:76: read oid 9 snap -1 2024-09-16T04:08:23.997 INFO:tasks.rados.rados.0.smithi204.stdout:76: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:23.999 INFO:tasks.rados.rados.0.smithi204.stdout:77: read oid 17 snap -1 2024-09-16T04:08:23.999 INFO:tasks.rados.rados.0.smithi204.stdout:77: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-16T04:08:23.999 INFO:tasks.rados.rados.0.smithi204.stdout:78: read oid 39 snap 3 2024-09-16T04:08:23.999 INFO:tasks.rados.rados.0.smithi204.stdout:78: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:08:23.999 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 36 current snap is 4 2024-09-16T04:08:23.999 INFO:tasks.rados.rados.0.smithi204.stdout:79: seq_num 60 ranges {589824=638976,1228800=376832} 2024-09-16T04:08:24.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T04:08:24.024 INFO:tasks.rados.rados.0.smithi204.stdout:79: writing smithi20431790-36 from 589824 to 1228800 tid 1 2024-09-16T04:08:24.031 INFO:tasks.rados.rados.0.smithi204.stdout:79: writing smithi20431790-36 from 1228800 to 1605632 tid 2 2024-09-16T04:08:24.031 INFO:tasks.rados.rados.0.smithi204.stdout:80: read oid 3 snap -1 2024-09-16T04:08:24.032 INFO:tasks.rados.rados.0.smithi204.stdout:80: expect (ObjNum 2 snap 0 seq_num 2) 2024-09-16T04:08:24.037 INFO:tasks.rados.rados.0.smithi204.stdout:75: expect (ObjNum 39 snap 0 seq_num 39) 2024-09-16T04:08:24.061 INFO:tasks.rados.rados.0.smithi204.stdout:77: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-16T04:08:24.072 INFO:tasks.rados.rados.0.smithi204.stdout:78: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:08:24.073 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.073 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.088 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:08:24.095 INFO:tasks.rados.rados.0.smithi204.stdout:76: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:24.101 INFO:tasks.rados.rados.0.smithi204.stdout:79: finishing write tid 1 to smithi20431790-36 2024-09-16T04:08:24.101 INFO:tasks.rados.rados.0.smithi204.stdout:79: finishing write tid 2 to smithi20431790-36 2024-09-16T04:08:24.101 INFO:tasks.rados.rados.0.smithi204.stdout:79: finishing write tid 3 to smithi20431790-36 2024-09-16T04:08:24.101 INFO:tasks.rados.rados.0.smithi204.stdout:79: finishing write tid 4 to smithi20431790-36 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:79: oid 36 updating version 0 to 7 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:79: oid 36 updating version 7 to 8 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:79: oid 36 version 8 is already newer than 6 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 36 v 8 (ObjNum 60 snap 4 seq_num 60) dirty exists 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:79: left oid 36 (ObjNum 60 snap 4 seq_num 60) 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:75: done (5 left) 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:76: done (4 left) 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:77: done (3 left) 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:78: done (2 left) 2024-09-16T04:08:24.102 INFO:tasks.rados.rados.0.smithi204.stdout:79: done (1 left) 2024-09-16T04:08:24.103 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 47 current snap is 4 2024-09-16T04:08:24.103 INFO:tasks.rados.rados.0.smithi204.stdout:81: seq_num 61 ranges {786432=655360,1441792=376832} 2024-09-16T04:08:24.110 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:24.106+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:24.124 INFO:tasks.rados.rados.0.smithi204.stdout:81: writing smithi20431790-47 from 786432 to 1441792 tid 1 2024-09-16T04:08:24.131 INFO:tasks.rados.rados.0.smithi204.stdout:81: writing smithi20431790-47 from 1441792 to 1818624 tid 2 2024-09-16T04:08:24.131 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 30 current snap is 4 2024-09-16T04:08:24.132 INFO:tasks.rados.rados.0.smithi204.stdout:82: seq_num 62 ranges {278528=671744,950272=376832} 2024-09-16T04:08:24.146 INFO:tasks.rados.rados.0.smithi204.stdout:82: writing smithi20431790-30 from 278528 to 950272 tid 1 2024-09-16T04:08:24.151 INFO:tasks.rados.rados.0.smithi204.stdout:82: writing smithi20431790-30 from 950272 to 1327104 tid 2 2024-09-16T04:08:24.151 INFO:tasks.rados.rados.0.smithi204.stdout:83: snap_remove snap 3 2024-09-16T04:08:24.183 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:24.180+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:24.214 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.214 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:08:24.284 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:24.278+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:24.347 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.348 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:08:24.385 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:24.381+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:24.486 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.486 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.487 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:24.486+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:24.499 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:08:24.587 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:24.584+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:24.617 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.617 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.631 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:08:24.689 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:24.685+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:24.762 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.762 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.776 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:08:24.790 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:24.785+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:24.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:24.891+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:24.919 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:24.919 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:24.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:24.934 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:08:24.991 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:24.986+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:24.999 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T04:08:25.000 INFO:tasks.rados.rados.0.smithi204.stdout:83: done (3 left) 2024-09-16T04:08:25.001 INFO:tasks.rados.rados.0.smithi204.stdout:84: delete oid 6 current snap is 4 2024-09-16T04:08:25.001 INFO:tasks.rados.rados.0.smithi204.stdout:80: expect (ObjNum 2 snap 0 seq_num 2) 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: finishing write tid 1 to smithi20431790-47 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: finishing write tid 2 to smithi20431790-47 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: finishing write tid 3 to smithi20431790-47 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: finishing write tid 4 to smithi20431790-47 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: oid 47 updating version 0 to 6 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: oid 47 updating version 6 to 8 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: oid 47 version 8 is already newer than 7 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 47 v 8 (ObjNum 61 snap 4 seq_num 61) dirty exists 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:81: left oid 47 (ObjNum 61 snap 4 seq_num 61) 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:82: finishing write tid 1 to smithi20431790-30 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:82: finishing write tid 2 to smithi20431790-30 2024-09-16T04:08:25.003 INFO:tasks.rados.rados.0.smithi204.stdout:82: finishing write tid 3 to smithi20431790-30 2024-09-16T04:08:25.004 INFO:tasks.rados.rados.0.smithi204.stdout:82: finishing write tid 4 to smithi20431790-30 2024-09-16T04:08:25.004 INFO:tasks.rados.rados.0.smithi204.stdout:82: oid 30 updating version 0 to 37 2024-09-16T04:08:25.004 INFO:tasks.rados.rados.0.smithi204.stdout:82: oid 30 version 37 is already newer than 36 2024-09-16T04:08:25.004 INFO:tasks.rados.rados.0.smithi204.stdout:82: oid 30 updating version 37 to 38 2024-09-16T04:08:25.004 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 38 (ObjNum 62 snap 4 seq_num 62) dirty exists 2024-09-16T04:08:25.004 INFO:tasks.rados.rados.0.smithi204.stdout:82: left oid 30 (ObjNum 62 snap 4 seq_num 62) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:80: done (3 left) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:81: done (2 left) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:82: done (1 left) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:84: done (0 left) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:85: read oid 34 snap -1 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:85: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:86: rollback oid 35 current snap is 4 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:86: done (1 left) 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 21 current snap is 4 2024-09-16T04:08:25.008 INFO:tasks.rados.rados.0.smithi204.stdout:87: seq_num 64 ranges {344064=704512,1048576=376832} 2024-09-16T04:08:25.022 INFO:tasks.rados.rados.0.smithi204.stdout:87: writing smithi20431790-21 from 344064 to 1048576 tid 1 2024-09-16T04:08:25.027 INFO:tasks.rados.rados.0.smithi204.stdout:87: writing smithi20431790-21 from 1048576 to 1425408 tid 2 2024-09-16T04:08:25.027 INFO:tasks.rados.rados.0.smithi204.stdout:88: rmattr oid 42 current snap is 4 2024-09-16T04:08:25.027 INFO:tasks.rados.rados.0.smithi204.stdout:88: done (2 left) 2024-09-16T04:08:25.027 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 45 current snap is 4 2024-09-16T04:08:25.027 INFO:tasks.rados.rados.0.smithi204.stdout:89: seq_num 65 ranges {753664=720896,1474560=376832} 2024-09-16T04:08:25.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T04:08:25.042 INFO:tasks.rados.rados.0.smithi204.stdout:89: writing smithi20431790-45 from 753664 to 1474560 tid 1 2024-09-16T04:08:25.046 INFO:tasks.rados.rados.0.smithi204.stdout:89: writing smithi20431790-45 from 1474560 to 1851392 tid 2 2024-09-16T04:08:25.046 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 35 current snap is 4 2024-09-16T04:08:25.046 INFO:tasks.rados.rados.0.smithi204.stdout:90: seq_num 66 ranges {0=737280,737280=376832} 2024-09-16T04:08:25.054 INFO:tasks.rados.rados.0.smithi204.stdout:90: writing smithi20431790-35 from 0 to 737280 tid 1 2024-09-16T04:08:25.058 INFO:tasks.rados.rados.0.smithi204.stdout:90: writing smithi20431790-35 from 737280 to 1114112 tid 2 2024-09-16T04:08:25.058 INFO:tasks.rados.rados.0.smithi204.stdout:91: rmattr oid 44 current snap is 4 2024-09-16T04:08:25.058 INFO:tasks.rados.rados.0.smithi204.stdout:91: done (4 left) 2024-09-16T04:08:25.058 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 15 current snap is 4 2024-09-16T04:08:25.058 INFO:tasks.rados.rados.0.smithi204.stdout:92: seq_num 67 ranges {245760=753664,999424=376832} 2024-09-16T04:08:25.067 INFO:tasks.rados.rados.0.smithi204.stdout:92: writing smithi20431790-15 from 245760 to 999424 tid 1 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:92: writing smithi20431790-15 from 999424 to 1376256 tid 2 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:93: copy_from oid 5 from oid 33 current snap is 4 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:94: copy_from oid 31 from oid 27 current snap is 4 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:95: read oid 14 snap -1 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:95: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:96: delete oid 3 current snap is 4 2024-09-16T04:08:25.073 INFO:tasks.rados.rados.0.smithi204.stdout:85: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-16T04:08:25.085 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:25.085 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:25.097 INFO:tasks.rados.rados.0.smithi204.stdout:87: finishing write tid 1 to smithi20431790-21 2024-09-16T04:08:25.097 INFO:tasks.rados.rados.0.smithi204.stdout:87: finishing write tid 2 to smithi20431790-21 2024-09-16T04:08:25.097 INFO:tasks.rados.rados.0.smithi204.stdout:85: done (8 left) 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:96: done (7 left) 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:97: setattr oid 49 current snap is 4 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:87: finishing write tid 3 to smithi20431790-21 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:87: finishing write tid 4 to smithi20431790-21 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:87: oid 21 updating version 0 to 24 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:87: oid 21 updating version 24 to 25 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:87: oid 21 updating version 25 to 26 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 21 v 26 (ObjNum 64 snap 4 seq_num 64) dirty exists 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:87: left oid 21 (ObjNum 64 snap 4 seq_num 64) 2024-09-16T04:08:25.098 INFO:tasks.rados.rados.0.smithi204.stdout:89: finishing write tid 1 to smithi20431790-45 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: finishing write tid 2 to smithi20431790-45 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: finishing write tid 3 to smithi20431790-45 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: finishing write tid 4 to smithi20431790-45 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: oid 45 updating version 0 to 39 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: oid 45 updating version 39 to 41 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: oid 45 version 41 is already newer than 40 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 45 v 41 (ObjNum 65 snap 4 seq_num 65) dirty exists 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:89: left oid 45 (ObjNum 65 snap 4 seq_num 65) 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:90: finishing write tid 1 to smithi20431790-35 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:90: finishing write tid 2 to smithi20431790-35 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:90: finishing write tid 3 to smithi20431790-35 2024-09-16T04:08:25.099 INFO:tasks.rados.rados.0.smithi204.stdout:90: finishing write tid 4 to smithi20431790-35 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:90: oid 35 updating version 0 to 11 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:90: oid 35 updating version 11 to 12 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:90: oid 35 updating version 12 to 13 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 35 v 13 (ObjNum 66 snap 4 seq_num 66) dirty exists 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:90: left oid 35 (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:92: finishing write tid 1 to smithi20431790-15 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:92: finishing write tid 2 to smithi20431790-15 2024-09-16T04:08:25.100 INFO:tasks.rados.rados.0.smithi204.stdout:92: finishing write tid 3 to smithi20431790-15 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:92: finishing write tid 4 to smithi20431790-15 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:92: oid 15 updating version 0 to 19 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:92: oid 15 version 19 is already newer than 18 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:92: oid 15 version 19 is already newer than 17 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 15 v 19 (ObjNum 67 snap 4 seq_num 67) dirty exists 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:92: left oid 15 (ObjNum 67 snap 4 seq_num 67) 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:94: finishing copy_from racing read to smithi20431790-31 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:93: finishing copy_from racing read to smithi20431790-5 2024-09-16T04:08:25.101 INFO:tasks.rados.rados.0.smithi204.stdout:93: finishing copy_from to smithi20431790-5 2024-09-16T04:08:25.102 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 2 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:08:25.102 INFO:tasks.rados.rados.0.smithi204.stdout:94: finishing copy_from to smithi20431790-31 2024-09-16T04:08:25.102 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 31 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-16T04:08:25.102 INFO:tasks.rados.rados.0.smithi204.stdout:95: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:25.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:08:25.106 INFO:tasks.rados.rados.0.smithi204.stdout:87: done (7 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:89: done (6 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:90: done (5 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:92: done (4 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:93: done (3 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:94: done (2 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:95: done (1 left) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:98: read oid 48 snap -1 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:98: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 2 current snap is 4 2024-09-16T04:08:25.107 INFO:tasks.rados.rados.0.smithi204.stdout:99: seq_num 69 ranges {32768=786432,819200=376832} 2024-09-16T04:08:25.111 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:25.111 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:25.111 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:25.106+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:25.112 INFO:tasks.rados.rados.0.smithi204.stdout:99: writing smithi20431790-2 from 32768 to 819200 tid 1 2024-09-16T04:08:25.115 INFO:tasks.rados.rados.0.smithi204.stdout:99: writing smithi20431790-2 from 819200 to 1196032 tid 2 2024-09-16T04:08:25.115 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 27 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-16T04:08:25.116 INFO:tasks.rados.rados.0.smithi204.stdout:97: done (2 left) 2024-09-16T04:08:25.116 INFO:tasks.rados.rados.0.smithi204.stdout:100: rollback oid 15 current snap is 4 2024-09-16T04:08:25.116 INFO:tasks.rados.rados.0.smithi204.stdout:100: done (2 left) 2024-09-16T04:08:25.116 INFO:tasks.rados.rados.0.smithi204.stdout:101: setattr oid 27 current snap is 4 2024-09-16T04:08:25.117 INFO:tasks.rados.rados.0.smithi204.stdout:102: rollback oid 3 current snap is 4 2024-09-16T04:08:25.117 INFO:tasks.rados.rados.0.smithi204.stdout:102: done (3 left) 2024-09-16T04:08:25.117 INFO:tasks.rados.rados.0.smithi204.stdout:103: delete oid 11 current snap is 4 2024-09-16T04:08:25.119 INFO:tasks.rados.rados.0.smithi204.stdout:98: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:25.136 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:25.137 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:99: finishing write tid 1 to smithi20431790-2 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:99: finishing write tid 2 to smithi20431790-2 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:99: finishing write tid 3 to smithi20431790-2 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:98: done (3 left) 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:103: done (2 left) 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:104: read oid 19 snap -1 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:104: expect (ObjNum 35 snap 0 seq_num 35) 2024-09-16T04:08:25.150 INFO:tasks.rados.rados.0.smithi204.stdout:105: rollback oid 15 current snap is 4 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:105: done (3 left) 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 45 current snap is 4 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 27 v 10 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:99: finishing write tid 4 to smithi20431790-2 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:99: oid 2 updating version 0 to 13 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:99: oid 2 version 13 is already newer than 11 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:99: oid 2 version 13 is already newer than 12 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 2 v 13 (ObjNum 69 snap 4 seq_num 69) dirty exists 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:99: left oid 2 (ObjNum 69 snap 4 seq_num 69) 2024-09-16T04:08:25.151 INFO:tasks.rados.rados.0.smithi204.stdout:106: seq_num 71 ranges {1851392=425984,2277376=573440,2850816=196608} 2024-09-16T04:08:25.158 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:25.158 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:25.163 INFO:tasks.rados.rados.0.smithi204.stdout:106: writing smithi20431790-45 from 1851392 to 2277376 tid 1 2024-09-16T04:08:25.166 INFO:tasks.rados.rados.0.smithi204.stdout:106: writing smithi20431790-45 from 2277376 to 2850816 tid 2 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:106: writing smithi20431790-45 from 2850816 to 3047424 tid 3 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:99: done (3 left) 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:101: done (2 left) 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:107: read oid 27 snap -1 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:107: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:108: read oid 24 snap -1 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:108: expect (ObjNum 23 snap 0 seq_num 23) 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:109: snap_create 2024-09-16T04:08:25.168 INFO:tasks.rados.rados.0.smithi204.stdout:104: expect (ObjNum 35 snap 0 seq_num 35) 2024-09-16T04:08:25.177 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:25.178 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:25.192 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:25.188+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:25.195 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:25.195 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:25.201 INFO:tasks.rados.rados.0.smithi204.stdout:106: finishing write tid 1 to smithi20431790-45 2024-09-16T04:08:25.201 INFO:tasks.rados.rados.0.smithi204.stdout:107: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:25.217 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:25.218 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:25.226 INFO:tasks.rados.rados.0.smithi204.stdout:106: finishing write tid 2 to smithi20431790-45 2024-09-16T04:08:25.226 INFO:tasks.rados.rados.0.smithi204.stdout:108: expect (ObjNum 23 snap 0 seq_num 23) 2024-09-16T04:08:25.227 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:25.228 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:25.238 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:25.239 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: finishing write tid 3 to smithi20431790-45 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: finishing write tid 4 to smithi20431790-45 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: finishing write tid 5 to smithi20431790-45 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: oid 45 updating version 0 to 46 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: oid 45 version 46 is already newer than 44 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: oid 45 version 46 is already newer than 45 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: oid 45 updating version 46 to 47 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 45 v 47 (ObjNum 71 snap 4 seq_num 71) dirty exists 2024-09-16T04:08:25.241 INFO:tasks.rados.rados.0.smithi204.stdout:106: left oid 45 (ObjNum 71 snap 4 seq_num 71) 2024-09-16T04:08:25.242 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:08:25.256 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:25.256 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:25.276 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:25.276 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:25.293 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:25.289+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:25.296 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:25.297 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:25.318 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:25.318 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:25.337 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:25.337 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:25.357 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:25.357 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:25.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:25.379 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:25.393 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:25.391+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:25.402 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:25.402 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:25.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:25.402+0000 7f1ac1dc4640 0 -- 172.21.15.32:0/3509448427 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7f1abc2268a0 msgr2=0x7f1abc228c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:25.412 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:25.413 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:25.413 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:25.413 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:25.413 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:25.426 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:25.427 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:25.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:08:25.494 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:25.492+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:25.551 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:25.551 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 33/31 ECSubWrite(tid=158, reqid=client.4631.0:10, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.933078+0000", 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.6161325820000005, 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018776380000000001, 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933078+0000", 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933078+0000", 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933079+0000", 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4799999999999999e-07 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933121+0000", 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2184999999999997e-05 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933143+0000", 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1793999999999998e-05 2024-09-16T04:08:25.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933156+0000", 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3688e-05 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933710+0000", 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00055400800000000004 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933720+0000", 2024-09-16T04:08:25.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8009999999999998e-06 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934910+0000", 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0011898550000000001 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934956+0000", 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5958999999999998e-05 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.556 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 33/31 ECSubWrite(tid=159, reqid=client.4631.0:11, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.934363+0000", 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.6148478229999998, 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029678, 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934363+0000", 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934363+0000", 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934364+0000", 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.097e-06 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934388+0000", 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3904999999999999e-05 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934405+0000", 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7292e-05 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934417+0000", 2024-09-16T04:08:25.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2028000000000001e-05 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934599+0000", 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018167300000000001 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934608+0000", 2024-09-16T04:08:25.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9290000000000004e-06 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937290+0000", 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026824510000000002 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937331+0000", 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0425e-05 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.561 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.6128741600000005, 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003553507, 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:25.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.53e-07 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936618+0000", 2024-09-16T04:08:25.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000281468 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936637+0000", 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8558000000000001e-05 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936667+0000", 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0105000000000001e-05 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936800+0000", 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013247399999999999 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936810+0000", 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0178e-05 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939853+0000", 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030432739999999999 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939890+0000", 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7197000000000003e-05 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 33/31 ECSubWrite(tid=4, reqid=client.4631.0:19, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.6078829070000005, 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046610189999999998, 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.566 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941329+0000", 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0720000000000001e-06 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941664+0000", 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033524 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941685+0000", 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0548999999999999e-05 2024-09-16T04:08:25.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941695+0000", 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0696999999999999e-05 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942769+0000", 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010735 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942777+0000", 2024-09-16T04:08:25.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4950000000000008e-06 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945953+0000", 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031750350000000001 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945989+0000", 2024-09-16T04:08:25.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6430999999999997e-05 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.941725+0000", 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.6074858509999999, 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039764700000000002, 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941725+0000", 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941725+0000", 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941726+0000", 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1600000000000001e-07 2024-09-16T04:08:25.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941741+0000", 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5693e-05 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942725+0000", 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00098408400000000009 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942736+0000", 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0366e-05 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942797+0000", 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0976e-05 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942808+0000", 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1644000000000001e-05 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945662+0000", 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028535570000000001 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945701+0000", 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9634e-05 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 33/31 ECSubWrite(tid=5, reqid=client.4631.0:20, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.942764+0000", 2024-09-16T04:08:25.575 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.6064467679999996, 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003248595, 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942764+0000", 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942764+0000", 2024-09-16T04:08:25.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942765+0000", 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6799999999999999e-07 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942785+0000", 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9865999999999999e-05 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942796+0000", 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0947999999999999e-05 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942807+0000", 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1678999999999999e-05 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943191+0000", 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038316899999999999 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943222+0000", 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1565e-05 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945992+0000", 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027703659999999998 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946013+0000", 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0234e-05 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.579 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=162, reqid=client.4631.0:37, at_version=34'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.600492633, 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005624703, 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.580 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7399999999999999e-07 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948775+0000", 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6127e-05 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948794+0000", 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9264000000000001e-05 2024-09-16T04:08:25.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948804+0000", 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7499999999999998e-06 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949606+0000", 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080285899999999995 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949616+0000", 2024-09-16T04:08:25.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6900000000000004e-06 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954283+0000", 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046664230000000003 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954343+0000", 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0316000000000003e-05 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=163, reqid=client.4631.0:38, at_version=34'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5993505070000005, 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045180239999999998, 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949861+0000", 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1149999999999999e-06 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949901+0000", 2024-09-16T04:08:25.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9934000000000001e-05 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949919+0000", 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7291000000000001e-05 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949932+0000", 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3383e-05 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950027+0000", 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4493000000000005e-05 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950035+0000", 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2689999999999999e-06 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954354+0000", 2024-09-16T04:08:25.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0043187429999999999 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954378+0000", 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4796000000000001e-05 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:25.590 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.977853+0000", 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5713578990000006, 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003416283, 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977853+0000", 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977853+0000", 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977854+0000", 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6899999999999997e-07 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977868+0000", 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4144e-05 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977876+0000", 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5529999999999993e-06 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977883+0000", 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4339999999999997e-06 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978377+0000", 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00049401100000000004 2024-09-16T04:08:25.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.594 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.594 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.594 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978386+0000", 2024-09-16T04:08:25.594 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7800000000000006e-06 2024-09-16T04:08:25.596 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.596 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.981233+0000", 2024-09-16T04:08:25.596 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028476030000000002 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.981269+0000", 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6089e-05 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.983208+0000", 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5660025540000007, 2024-09-16T04:08:25.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032179079999999998, 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983208+0000", 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983208+0000", 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983209+0000", 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0299999999999997e-07 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983383+0000", 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017368700000000001 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983403+0000", 2024-09-16T04:08:25.599 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0115e-05 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983409+0000", 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2099999999999998e-06 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983459+0000", 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0263999999999999e-05 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.983466+0000", 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.37e-06 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.986381+0000", 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002914818 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.986426+0000", 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5541000000000003e-05 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.601 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s6 34/31 ECSubWrite(tid=0, reqid=client.4631.0:76, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.994591+0000", 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5546203100000007, 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001776527, 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.994591+0000", 2024-09-16T04:08:25.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.994591+0000", 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.994591+0000", 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5799999999999999e-07 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995222+0000", 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000631148 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995237+0000", 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5071e-05 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995247+0000", 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4960000000000002e-06 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995338+0000", 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.1475000000000001e-05 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.995346+0000", 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1750000000000005e-06 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.996333+0000", 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00098615000000000009 2024-09-16T04:08:25.605 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.996367+0000", 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4453999999999999e-05 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.6s1 34/31 ECSubWrite(tid=0, reqid=client.4631.0:103, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.025437+0000", 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5237742539999992, 2024-09-16T04:08:25.606 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002040104, 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025437+0000", 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025437+0000", 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025437+0000", 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0800000000000001e-07 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025873+0000", 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00043601700000000002 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025891+0000", 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8355999999999998e-05 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025899+0000", 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7749999999999993e-06 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025959+0000", 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0041999999999999e-05 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.025965+0000", 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5350000000000004e-06 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.027440+0000", 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0014752700000000001 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.027477+0000", 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6900999999999998e-05 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.610 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s6 34/31 ECSubWrite(tid=5, reqid=client.4631.0:107, at_version=34'4, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.028987+0000", 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5202234969999999, 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018143429999999999, 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028987+0000", 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028987+0000", 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.028988+0000", 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4799999999999998e-07 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.029004+0000", 2024-09-16T04:08:25.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5730999999999999e-05 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.029013+0000", 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5759999999999995e-06 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.029021+0000", 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3549999999999999e-06 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.029314+0000", 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029374499999999999 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.029322+0000", 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0409999999999998e-06 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030771+0000", 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0014488369999999999 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030802+0000", 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0510000000000001e-05 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.6s1 34/31 ECSubWrite(tid=2, reqid=client.4631.0:104, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.030437+0000", 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.5187742499999999, 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0024851700000000001, 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.615 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030437+0000", 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030437+0000", 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.616 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030437+0000", 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2900000000000002e-07 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030446+0000", 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9269999999999994e-06 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030457+0000", 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0491e-05 2024-09-16T04:08:25.617 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030465+0000", 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0760000000000003e-06 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030521+0000", 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6004000000000001e-05 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.030526+0000", 2024-09-16T04:08:25.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0869999999999997e-06 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.032888+0000", 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0023616610000000001 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.032922+0000", 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4094999999999998e-05 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.619 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=181, reqid=client.4631.0:128, at_version=34'10, trim_to=0'0, roll_forward_to=34'8))", 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.058501+0000", 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.4907099200000005, 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002645306, 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.620 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058501+0000", 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058501+0000", 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058502+0000", 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4600000000000003e-07 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.621 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058520+0000", 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8342000000000002e-05 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058532+0000", 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2361000000000001e-05 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058541+0000", 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3529999999999995e-06 2024-09-16T04:08:25.622 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058627+0000", 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5762999999999999e-05 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.058637+0000", 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0199e-05 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061119+0000", 2024-09-16T04:08:25.623 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0024821629999999999 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061146+0000", 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7279000000000001e-05 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=182, reqid=client.4631.0:128, at_version=0'0, trim_to=0'0, roll_forward_to=34'10))", 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.061753+0000", 2024-09-16T04:08:25.624 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 8.4874574220000003, 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002260036, 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061753+0000", 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.625 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061753+0000", 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061754+0000", 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8599999999999996e-07 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061766+0000", 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1232e-05 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.626 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061782+0000", 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6620999999999999e-05 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061791+0000", 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8899999999999996e-06 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061854+0000", 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3126999999999994e-05 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.627 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.061860+0000", 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6829999999999996e-06 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.063979+0000", 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0021190250000000001 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.064013+0000", 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4471999999999998e-05 2024-09-16T04:08:25.628 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 38/31 ECSubWrite(tid=32, reqid=client.4631.0:186, at_version=38'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:20.971918+0000", 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.5772932820000003, 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002116368, 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.629 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.971918+0000", 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.971918+0000", 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.971918+0000", 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5999999999999999e-07 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.630 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.971961+0000", 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2928e-05 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.971979+0000", 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7975999999999999e-05 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.971996+0000", 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6716000000000001e-05 2024-09-16T04:08:25.631 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.972137+0000", 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000141175 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.972172+0000", 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5583000000000001e-05 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.973966+0000", 2024-09-16T04:08:25.632 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0017936790000000001 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.974034+0000", 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7951e-05 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 38/31 ECSubWrite(tid=33, reqid=client.4631.0:186, at_version=0'0, trim_to=0'0, roll_forward_to=38'8))", 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:20.978638+0000", 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.5705730759999996, 2024-09-16T04:08:25.633 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019695870000000001, 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978638+0000", 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978638+0000", 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.634 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978639+0000", 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.677e-06 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978662+0000", 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2362e-05 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978691+0000", 2024-09-16T04:08:25.635 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8853e-05 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978707+0000", 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5866e-05 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978820+0000", 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0001139 2024-09-16T04:08:25.637 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.978837+0000", 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.662e-05 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.980554+0000", 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0017165590000000001 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:20.980607+0000", 2024-09-16T04:08:25.638 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3749999999999999e-05 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.6s1 38/31 ECSubWrite(tid=10, reqid=osd.14.0:10, at_version=38'6, trim_to=0'0, roll_forward_to=37'4))", 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:21.033938+0000", 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.5152731780000002, 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028018520000000001, 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.639 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.033938+0000", 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.033938+0000", 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.033938+0000", 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6000000000000003e-07 2024-09-16T04:08:25.640 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.033999+0000", 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0355000000000001e-05 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034034+0000", 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5212000000000001e-05 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034059+0000", 2024-09-16T04:08:25.641 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4966000000000001e-05 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034220+0000", 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000160915 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034244+0000", 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4022000000000001e-05 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.036652+0000", 2024-09-16T04:08:25.642 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002407888 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.036740+0000", 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7834e-05 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.6s1 38/31 ECSubWrite(tid=11, reqid=osd.14.0:10, at_version=0'0, trim_to=0'0, roll_forward_to=38'6))", 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:21.040421+0000", 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.5087899330000001, 2024-09-16T04:08:25.643 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018684159999999999, 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040421+0000", 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040421+0000", 2024-09-16T04:08:25.644 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040423+0000", 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5999999999999999e-06 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040447+0000", 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4975999999999999e-05 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:25.645 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040479+0000", 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1262e-05 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040496+0000", 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7025999999999999e-05 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040676+0000", 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000180314 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:25.646 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.040691+0000", 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4596000000000001e-05 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.042201+0000", 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0015098310000000001 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.042289+0000", 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8811000000000001e-05 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.647 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:25.648 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:25.648 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:25.649 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:08:25.650 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:25.647+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:25.750 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:25.750+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:25.821 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:25.821 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:25.821 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:25.821 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:25.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:08:25.851 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:25.850+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:25.952 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:25.952 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:25.952 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:25.952 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:25.953 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:25.953 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:25.949+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:25.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:08:26.013 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:104: done (4 left) 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:106: done (3 left) 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:107: done (2 left) 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:108: done (1 left) 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:109: done (0 left) 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 43 current snap is 5 2024-09-16T04:08:26.014 INFO:tasks.rados.rados.0.smithi204.stdout:110: seq_num 72 ranges {1622016=442368,2064384=720896,2785280=49152} 2024-09-16T04:08:26.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-16T04:08:26.028 INFO:tasks.rados.rados.0.smithi204.stdout:110: writing smithi20431790-43 from 1622016 to 2064384 tid 1 2024-09-16T04:08:26.034 INFO:tasks.rados.rados.0.smithi204.stdout:110: writing smithi20431790-43 from 2064384 to 2785280 tid 2 2024-09-16T04:08:26.035 INFO:tasks.rados.rados.0.smithi204.stdout:110: writing smithi20431790-43 from 2785280 to 2834432 tid 3 2024-09-16T04:08:26.035 INFO:tasks.rados.rados.0.smithi204.stdout:111: delete oid 13 current snap is 5 2024-09-16T04:08:26.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T04:08:26.041 INFO:tasks.rados.rados.0.smithi204.stdout:110: finishing write tid 1 to smithi20431790-43 2024-09-16T04:08:26.043 INFO:tasks.rados.rados.0.smithi204.stdout:110: finishing write tid 2 to smithi20431790-43 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:110: finishing write tid 3 to smithi20431790-43 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:110: finishing write tid 4 to smithi20431790-43 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:111: done (1 left) 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:112: read oid 21 snap 4 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:112: expect (ObjNum 64 snap 4 seq_num 64) 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:113: read oid 27 snap -1 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:113: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:26.045 INFO:tasks.rados.rados.0.smithi204.stdout:114: snap_create 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:110: finishing write tid 5 to smithi20431790-43 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:110: oid 43 updating version 0 to 23 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:110: oid 43 updating version 23 to 24 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:110: oid 43 version 24 is already newer than 22 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:110: oid 43 version 24 is already newer than 21 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 43 v 24 (ObjNum 72 snap 5 seq_num 72) dirty exists 2024-09-16T04:08:26.046 INFO:tasks.rados.rados.0.smithi204.stdout:110: left oid 43 (ObjNum 72 snap 5 seq_num 72) 2024-09-16T04:08:26.053 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:26.049+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:26.056 INFO:tasks.rados.rados.0.smithi204.stdout:112: expect (ObjNum 64 snap 4 seq_num 64) 2024-09-16T04:08:26.102 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4347.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.417117619999999, 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.078945607000000001, 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.103 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4347", 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680776+0000", 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.105 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680789+0000", 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3190000000000001e-05 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680818+0000", 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9221999999999999e-05 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680843+0000", 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5341e-05 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681117+0000", 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027343099999999998 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681133+0000", 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6121999999999999e-05 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756693+0000", 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.075560459999999996 2024-09-16T04:08:26.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756940+0000", 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000246987 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 5", 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.757281+0000", 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034121100000000001 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758584+0000", 2024-09-16T04:08:26.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013029490000000001 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759577+0000", 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00099302500000000003 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759652+0000", 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4519999999999998e-05 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759718+0000", 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5798999999999998e-05 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.411406553999999, 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.074795126000000003, 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.110 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:08:26.111 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686485+0000", 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.658e-06 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686493+0000", 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4970000000000001e-06 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.112 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686508+0000", 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4491999999999999e-05 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686518+0000", 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0458e-05 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686592+0000", 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3489000000000001e-05 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686600+0000", 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9230000000000002e-06 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758022+0000", 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.071421947 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758412+0000", 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038979599999999998 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.114 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758762+0000", 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00035026099999999999 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.760052+0000", 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012898219999999999 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761194+0000", 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001142505 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.115 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761242+0000", 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7673000000000002e-05 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761278+0000", 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6604999999999999e-05 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.116 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.081085+0000", 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.016805005999998, 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017057064, 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 114 2024-09-16T04:08:26.117 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081085+0000", 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081085+0000", 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.118 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081086+0000", 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2470000000000001e-06 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081096+0000", 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0363000000000001e-05 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081114+0000", 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7512000000000001e-05 2024-09-16T04:08:26.119 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081127+0000", 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3573e-05 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.120 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.092897+0000", 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011769078000000001 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.093026+0000", 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012983 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.093233+0000", 2024-09-16T04:08:26.121 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020634900000000001 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.096943+0000", 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0037098159999999999 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098006+0000", 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00106361 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.122 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098083+0000", 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6985999999999998e-05 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098142+0000", 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8699999999999997e-05 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.123 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.081181+0000", 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.016708950999998, 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018028845000000002, 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.124 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 115 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081181+0000", 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081181+0000", 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.125 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081183+0000", 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9599999999999999e-06 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081398+0000", 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021505800000000001 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081422+0000", 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3666e-05 2024-09-16T04:08:26.126 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081442+0000", 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0826e-05 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.095119+0000", 2024-09-16T04:08:26.127 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013676541 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.095315+0000", 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019571399999999999 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.095639+0000", 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00032434800000000002 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.128 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099049+0000", 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003410111 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099076+0000", 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6548000000000001e-05 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099152+0000", 2024-09-16T04:08:26.129 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6695999999999999e-05 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099210+0000", 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7377000000000003e-05 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.081473+0000", 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.01641695, 2024-09-16T04:08:26.130 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017968387999999998, 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 116 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081473+0000", 2024-09-16T04:08:26.131 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081473+0000", 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081474+0000", 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.497e-06 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.132 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081486+0000", 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1409e-05 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081506+0000", 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9851999999999999e-05 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.133 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081520+0000", 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4355999999999999e-05 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.097045+0000", 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015524632999999999 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.097234+0000", 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018966299999999999 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.134 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.097426+0000", 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019223999999999999 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099240+0000", 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001813159 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099313+0000", 2024-09-16T04:08:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3845999999999997e-05 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099387+0000", 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3862999999999994e-05 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099441+0000", 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3869999999999998e-05 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.136 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.081572+0000", 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.016317877999999, 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018489616, 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.137 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 117 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081572+0000", 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081572+0000", 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.138 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081574+0000", 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6330000000000001e-06 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081585+0000", 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1769e-05 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.139 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081604+0000", 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8746e-05 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081622+0000", 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7482e-05 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.140 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098224+0000", 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.016602888 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098357+0000", 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013302 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098549+0000", 2024-09-16T04:08:26.141 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019195 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099717+0000", 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0011676830000000001 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099932+0000", 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021476500000000001 2024-09-16T04:08:26.142 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.100007+0000", 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5343e-05 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.100062+0000", 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4336999999999998e-05 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.143 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.420955+0000", 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 23.676934506999999, 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.016882880999999999, 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.144 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 162 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420955+0000", 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.145 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420955+0000", 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420956+0000", 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2699999999999998e-07 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420963+0000", 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2960000000000004e-06 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.146 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420972+0000", 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4599999999999992e-06 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420979+0000", 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1289999999999998e-06 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.431256+0000", 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010277272 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.147 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.431382+0000", 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012532400000000001 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.431567+0000", 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018497000000000001 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436152+0000", 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045856200000000003 2024-09-16T04:08:26.148 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.437710+0000", 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00155806 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.437772+0000", 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.1653000000000001e-05 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.149 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.437838+0000", 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6169999999999998e-05 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.420990+0000", 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 23.676900197999998, 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017230298000000002, 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.150 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 163 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420990+0000", 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420990+0000", 2024-09-16T04:08:26.151 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420990+0000", 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5600000000000005e-07 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.420999+0000", 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2329999999999995e-06 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.152 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421009+0000", 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3600000000000002e-06 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421018+0000", 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2860000000000005e-06 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.432804+0000", 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011785820000000001 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.153 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.432962+0000", 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015756200000000001 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.433165+0000", 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020348600000000001 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.437851+0000", 2024-09-16T04:08:26.154 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046858150000000003 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.437970+0000", 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000118717 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.438127+0000", 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015781500000000001 2024-09-16T04:08:26.155 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.438220+0000", 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2547999999999996e-05 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.156 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.421097+0000", 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 23.676792611, 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018176101, 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 164 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.157 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421097+0000", 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421097+0000", 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.158 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421098+0000", 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0499999999999999e-06 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421176+0000", 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7929000000000006e-05 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.159 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421190+0000", 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.342e-05 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421199+0000", 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3360000000000001e-06 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.160 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.434116+0000", 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012916893 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.434262+0000", 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014603199999999999 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.161 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.434652+0000", 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00039001200000000002 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.437861+0000", 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032093450000000002 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.162 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439133+0000", 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001271358 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439214+0000", 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1252000000000001e-05 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439273+0000", 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.9474e-05 2024-09-16T04:08:26.163 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.421215+0000", 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 23.676674813999998, 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018607317000000002, 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.164 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 165 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421215+0000", 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.165 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421215+0000", 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421216+0000", 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7700000000000003e-07 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421222+0000", 2024-09-16T04:08:26.166 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3559999999999998e-06 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421232+0000", 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3360000000000001e-06 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421241+0000", 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2960000000000004e-06 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.167 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436230+0000", 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014989426 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436396+0000", 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016566399999999999 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436855+0000", 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00045879200000000002 2024-09-16T04:08:26.168 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.438245+0000", 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013906890000000001 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439687+0000", 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001442062 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.169 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439765+0000", 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7405999999999997e-05 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439822+0000", 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7413000000000001e-05 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:10 3.2s0 3:47904bf5:::smithi20431790-4:head [append 0~65536,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:08:26.170 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1657926009999997, 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018864736, 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 10 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:08:26.171 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932099+0000", 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2199999999999999e-06 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.172 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932178+0000", 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932195+0000", 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7448999999999998e-05 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932210+0000", 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5338000000000001e-05 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.173 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932298+0000", 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8108000000000004e-05 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932407+0000", 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000108142 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933041+0000", 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00063471100000000004 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.174 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935398+0000", 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0023565420000000001 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950884+0000", 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015486107000000001 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950962+0000", 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7970000000000001e-05 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.175 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:11 3.2s0 3:47904bf5:::smithi20431790-4:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1656351160000007, 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018963179, 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.176 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 11 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.177 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9400000000000005e-07 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932260+0000", 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9710000000000003e-06 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932272+0000", 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1394e-05 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.178 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932280+0000", 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6540000000000005e-06 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933560+0000", 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012794550000000001 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933703+0000", 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014327099999999999 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.179 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934311+0000", 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00060811199999999995 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001087619 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951109+0000", 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015710114000000001 2024-09-16T04:08:26.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951218+0000", 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010889499999999999 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:12 3.2s0 3:47904bf5:::smithi20431790-4:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1655638249999996, 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026513838000000001, 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.181 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 12 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932327+0000", 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4600000000000003e-07 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932331+0000", 2024-09-16T04:08:26.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932343+0000", 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2442999999999999e-05 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932356+0000", 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2947e-05 2024-09-16T04:08:26.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935242+0000", 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028857570000000001 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935348+0000", 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010570500000000001 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.185 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951277+0000", 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015929606999999998 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951330+0000", 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2148000000000003e-05 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.958840+0000", 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0075102520000000002 2024-09-16T04:08:26.186 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:25 3.8s0 3:11971f68:::smithi20431790-9:head [append 0~147456,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938661+0000", 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1592288269999997, 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018494454, 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.187 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 25 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938661+0000", 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.188 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938661+0000", 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.384e-06 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938779+0000", 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011633699999999999 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938793+0000", 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4586000000000001e-05 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938803+0000", 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2790000000000004e-06 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938868+0000", 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5343000000000001e-05 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938988+0000", 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000120093 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939579+0000", 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00059097900000000005 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943478+0000", 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038985410000000002 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957071+0000", 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013593010000000001 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957155+0000", 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4901999999999995e-05 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.192 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:26 3.8s0 3:11971f68:::smithi20431790-9:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938825+0000", 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1590644460000004, 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018583538, 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.193 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 26 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938825+0000", 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938825+0000", 2024-09-16T04:08:26.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938826+0000", 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4300000000000003e-07 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938830+0000", 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1740000000000002e-06 2024-09-16T04:08:26.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938838+0000", 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5900000000000002e-06 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938844+0000", 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5930000000000002e-06 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939943+0000", 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010986889999999999 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940019+0000", 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6460999999999999e-05 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940434+0000", 2024-09-16T04:08:26.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00041424300000000001 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943480+0000", 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030464889999999999 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957322+0000", 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013841628 2024-09-16T04:08:26.198 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957409+0000", 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7027999999999994e-05 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.199 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:27 3.8s0 3:11971f68:::smithi20431790-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1590351339999998, 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023242002000000001, 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.200 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 27 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:26.201 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3399999999999999e-07 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938866+0000", 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0725e-05 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938877+0000", 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1277999999999999e-05 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938884+0000", 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1969999999999999e-06 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940649+0000", 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001764126 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940737+0000", 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8554000000000006e-05 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957784+0000", 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017047128000000002 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9390999999999999e-05 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.962097+0000", 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042329689999999996 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:39 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1504312999999993, 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018733970999999999, 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.205 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 39 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.206 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947459+0000", 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4000000000000002e-07 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947462+0000", 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8959999999999999e-06 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947471+0000", 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8680000000000005e-06 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947477+0000", 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3300000000000004e-06 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950100+0000", 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026232159999999998 2024-09-16T04:08:26.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950184+0000", 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3891e-05 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963530+0000", 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013345658 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963589+0000", 2024-09-16T04:08:26.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8748000000000001e-05 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966192+0000", 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026038239999999998 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:43 3.2s0 3:43e872cf:::smithi20431790-15:head [append 0~245760,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.952175+0000", 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1457152009999998, 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017288662, 2024-09-16T04:08:26.210 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 43 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952175+0000", 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952175+0000", 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952176+0000", 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5039999999999999e-06 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952329+0000", 2024-09-16T04:08:26.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000152678 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952337+0000", 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6309999999999992e-06 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952342+0000", 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6439999999999999e-06 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.953986+0000", 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001643872 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954185+0000", 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019914999999999999 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954956+0000", 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00077061800000000004 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959516+0000", 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045607729999999997 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.969416+0000", 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0098994770000000003 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.969463+0000", 2024-09-16T04:08:26.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7314999999999997e-05 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:44 3.2s0 3:43e872cf:::smithi20431790-15:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.952351+0000", 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1455391820000003, 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017280950999999999, 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.216 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.217 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.217 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 44 2024-09-16T04:08:26.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.217 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952351+0000", 2024-09-16T04:08:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952351+0000", 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952351+0000", 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.3099999999999998e-07 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952354+0000", 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8380000000000002e-06 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952358+0000", 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.755e-06 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952361+0000", 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.886e-06 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.956207+0000", 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038468700000000001 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.956295+0000", 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7515000000000005e-05 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.958434+0000", 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0021391449999999998 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.960400+0000", 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001965947 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.969567+0000", 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091671889999999992 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.969632+0000", 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4375000000000006e-05 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.225 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:45 3.2s0 3:43e872cf:::smithi20431790-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.1455253820000006, 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020624611000000001, 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 45 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.226 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952365+0000", 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.79e-07 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952366+0000", 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1400000000000001e-06 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952369+0000", 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5889999999999999e-06 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952372+0000", 2024-09-16T04:08:26.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7460000000000001e-06 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959119+0000", 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067464609999999996 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959501+0000", 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038236699999999999 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970077+0000", 2024-09-16T04:08:26.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010575599 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970122+0000", 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5423999999999997e-05 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.972989+0000", 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028670060000000001 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.231 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.231 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:26.232 INFO:tasks.rados.rados.0.smithi204.stdout:113: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:08:26.233 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:26.228+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:26.333 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:26.329+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:26.402 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:26.402 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:26.402 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:26.402 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:26.416 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:08:26.434 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:26.434+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:26.535 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:26.531+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:26.539 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:26.539 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:26.539 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:26.539 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:26.539 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:26.553 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:08:26.636 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:26.633+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:16 3.3s0 3:c529a602:::smithi20431790-6:head [append 0~98304,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:08:26.677 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7368052089999999, 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019299383, 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 16 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.678 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.679 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935202+0000", 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1500000000000002e-06 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935324+0000", 2024-09-16T04:08:26.680 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000121543 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935343+0000", 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9576e-05 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935354+0000", 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0305e-05 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.681 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935432+0000", 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935534+0000", 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102352 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936270+0000", 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00073583600000000002 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.682 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940246+0000", 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039756180000000002 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954404+0000", 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014158278 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954499+0000", 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5575999999999994e-05 2024-09-16T04:08:26.683 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:17 3.3s0 3:c529a602:::smithi20431790-6:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7366220319999996, 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019292492000000001, 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.684 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 17 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:08:26.685 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935384+0000", 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4099999999999997e-07 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935389+0000", 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2329999999999997e-06 2024-09-16T04:08:26.686 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8409999999999995e-06 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935409+0000", 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8600000000000005e-06 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.687 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936658+0000", 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012486140000000001 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936736+0000", 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8772999999999999e-05 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.688 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937204+0000", 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046781200000000001 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941222+0000", 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0040175799999999998 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.689 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954596+0000", 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013374425000000001 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954676+0000", 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9512999999999996e-05 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.690 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:18 3.3s0 3:c529a602:::smithi20431790-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7365846850000004, 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.028831239000000002, 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.691 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 18 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.692 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4700000000000001e-07 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935425+0000", 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3689999999999998e-06 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.693 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935433+0000", 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4379999999999995e-06 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935442+0000", 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2660000000000007e-06 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.694 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937434+0000", 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001991488 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937526+0000", 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2130000000000001e-05 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955047+0000", 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01752107 2024-09-16T04:08:26.695 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955134+0000", 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7058000000000006e-05 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.964252+0000", 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091177729999999992 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.696 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.8s3 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.939831+0000", 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7321740030000008, 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055632490000000001, 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939831+0000", 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939831+0000", 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939832+0000", 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5199999999999998e-07 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.698 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939895+0000", 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3804000000000001e-05 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939910+0000", 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4368e-05 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939920+0000", 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0210000000000001e-05 2024-09-16T04:08:26.699 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939987+0000", 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6641000000000001e-05 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939995+0000", 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0919999999999998e-06 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945330+0000", 2024-09-16T04:08:26.700 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053352470000000004 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945395+0000", 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4535000000000005e-05 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.701 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.bs3 34/31 ECSubWrite(tid=6, reqid=client.4631.0:40, at_version=34'3, trim_to=0'0, roll_forward_to=33'1))", 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.957571+0000", 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7144340089999996, 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0069680200000000001, 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957571+0000", 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.702 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957571+0000", 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957572+0000", 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6000000000000002e-07 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.703 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957645+0000", 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3183999999999996e-05 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957656+0000", 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1005999999999999e-05 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.704 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957664+0000", 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2049999999999996e-06 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.961379+0000", 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0037153820000000001 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.961389+0000", 2024-09-16T04:08:26.705 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0081999999999999e-05 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.964517+0000", 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031282329999999998 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.964539+0000", 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2067999999999999e-05 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.706 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.bs3 34/31 ECSubWrite(tid=8, reqid=client.4631.0:41, at_version=34'4, trim_to=0'0, roll_forward_to=33'1))", 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.959911+0000", 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7120943559999997, 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0077222189999999998, 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.707 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959911+0000", 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959911+0000", 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.708 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959911+0000", 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8299999999999997e-07 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959928+0000", 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6736999999999999e-05 2024-09-16T04:08:26.709 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959940+0000", 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1443e-05 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959947+0000", 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7160000000000003e-06 2024-09-16T04:08:26.710 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.961784+0000", 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018367660000000001 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.961793+0000", 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.1249999999999999e-06 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967605+0000", 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0058115529999999997 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967633+0000", 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8296000000000001e-05 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:52 3.3s0 3:cd6753c4:::smithi20431790-18:head [append 0~294912,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965376+0000", 2024-09-16T04:08:26.712 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7066290540000004, 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0078091469999999998, 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 52 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965376+0000", 2024-09-16T04:08:26.713 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965376+0000", 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965377+0000", 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.850000000000001e-07 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965608+0000", 2024-09-16T04:08:26.714 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000230745 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965622+0000", 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4066000000000001e-05 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965630+0000", 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5320000000000001e-06 2024-09-16T04:08:26.715 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965683+0000", 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3050000000000002e-05 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965802+0000", 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011954499999999999 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966444+0000", 2024-09-16T04:08:26.716 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000642214 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970010+0000", 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035652359999999998 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973093+0000", 2024-09-16T04:08:26.717 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030833259999999999 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973185+0000", 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2448000000000007e-05 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:53 3.3s0 3:cd6753c4:::smithi20431790-18:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:26.718 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7063595459999998, 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0082006900000000001, 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 53 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:26.719 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.720 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2500000000000005e-07 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965650+0000", 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.794e-06 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965657+0000", 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.17e-06 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.721 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965663+0000", 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8119999999999996e-06 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966972+0000", 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013091089999999999 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967054+0000", 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1687999999999994e-05 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.722 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967444+0000", 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038982600000000002 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.972552+0000", 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051083880000000002 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973765+0000", 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012128569999999999 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.723 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973846+0000", 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1321000000000003e-05 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:54 3.3s0 3:cd6753c4:::smithi20431790-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7063336380000003, 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012514735000000001, 2024-09-16T04:08:26.724 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 54 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.725 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8500000000000002e-07 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.726 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965675+0000", 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.717e-06 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965681+0000", 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3740000000000003e-06 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965688+0000", 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1319999999999996e-06 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.727 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967631+0000", 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001942608 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967683+0000", 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2407000000000002e-05 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0065591089999999996 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.728 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974296+0000", 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.304e-05 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978186+0000", 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003890863 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 34/31 ECSubWrite(tid=12, reqid=client.4631.0:28, at_version=34'5, trim_to=0'0, roll_forward_to=33'4))", 2024-09-16T04:08:26.729 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.971176+0000", 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.7008295859999993, 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067083289999999999, 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971176+0000", 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.730 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971176+0000", 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971177+0000", 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8999999999999995e-07 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971240+0000", 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3041999999999997e-05 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.731 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971254+0000", 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4174e-05 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971262+0000", 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8220000000000007e-06 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971324+0000", 2024-09-16T04:08:26.732 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.1898999999999998e-05 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.971332+0000", 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8799999999999997e-06 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977831+0000", 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064986230000000002 2024-09-16T04:08:26.733 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977884+0000", 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2998999999999999e-05 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:61 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [append 0~344064,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6981357369999994, 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014009466, 2024-09-16T04:08:26.734 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 61 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.735 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973871+0000", 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.42e-06 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974203+0000", 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000331649 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.736 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974215+0000", 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2428e-05 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974223+0000", 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4090000000000003e-06 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974499+0000", 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027562300000000001 2024-09-16T04:08:26.737 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974613+0000", 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011410500000000001 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.975669+0000", 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010556929999999999 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978426+0000", 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027567379999999999 2024-09-16T04:08:26.738 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987790+0000", 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093645580000000003 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987879+0000", 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8843000000000003e-05 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.739 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:62 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6977645680000002, 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01382477, 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 62 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.740 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.043e-06 2024-09-16T04:08:26.741 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974246+0000", 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7500000000000003e-06 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974255+0000", 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6889999999999993e-06 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974262+0000", 2024-09-16T04:08:26.742 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8020000000000003e-06 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976035+0000", 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001773513 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976098+0000", 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2561e-05 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.743 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976446+0000", 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034762200000000001 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978428+0000", 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019825789999999999 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987964+0000", 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0095358739999999997 2024-09-16T04:08:26.744 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988065+0000", 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101337 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:63 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6977361850000001, 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017999409000000001, 2024-09-16T04:08:26.745 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 63 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.746 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0200000000000003e-07 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974272+0000", 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6450000000000001e-06 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.747 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974280+0000", 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3900000000000004e-06 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974287+0000", 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9410000000000007e-06 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977414+0000", 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031265419999999999 2024-09-16T04:08:26.748 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977505+0000", 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0589999999999998e-05 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988472+0000", 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010967144999999999 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988572+0000", 2024-09-16T04:08:26.749 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9774999999999999e-05 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.992268+0000", 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003696979 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:122 3.3s0 3:cbefa139:::smithi20431790-41:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.045591+0000", 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6264144950000006, 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0074002310000000002, 2024-09-16T04:08:26.750 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 122 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045591+0000", 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.751 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045591+0000", 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045592+0000", 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3e-07 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045597+0000", 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1240000000000004e-06 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045606+0000", 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8729999999999996e-06 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045613+0000", 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.126e-06 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.047563+0000", 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001950287 2024-09-16T04:08:26.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.047639+0000", 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6435999999999998e-05 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048027+0000", 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038793600000000002 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048821+0000", 2024-09-16T04:08:26.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00079378100000000002 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.052840+0000", 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0040188660000000003 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.052991+0000", 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015107200000000001 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.755 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:123 3.3s0 3:cbefa139:::smithi20431790-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6263824890000009, 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091212429999999994, 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 123 2024-09-16T04:08:26.756 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.757 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0999999999999998e-07 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045626+0000", 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7360000000000001e-06 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045634+0000", 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.469e-06 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.758 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045640+0000", 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7340000000000002e-06 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048271+0000", 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026307589999999999 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048353+0000", 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2093000000000002e-05 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.759 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053037+0000", 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046837609999999998 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053109+0000", 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1594999999999995e-05 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.054744+0000", 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001635486 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.760 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:126 3.3s0 3:c16cfb96:::smithi20431790-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.050364+0000", 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6216407850000003, 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0058966460000000002, 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.761 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 126 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.050364+0000", 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.050364+0000", 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.762 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.050365+0000", 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4799999999999999e-07 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.050368+0000", 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1829999999999998e-06 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.050384+0000", 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5469e-05 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.763 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.050391+0000", 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6510000000000001e-06 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053808+0000", 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003416381 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053886+0000", 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8295999999999997e-05 2024-09-16T04:08:26.764 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.055214+0000", 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001327754 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.055281+0000", 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7642000000000001e-05 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.056261+0000", 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00097982199999999998 2024-09-16T04:08:26.765 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.6s2 38/31 ECSubWrite(tid=10, reqid=osd.14.0:10, at_version=38'6, trim_to=0'0, roll_forward_to=37'4))", 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:21.034337+0000", 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 5.6376680290000003, 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050917200000000001, 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.766 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034337+0000", 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034337+0000", 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034338+0000", 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1399999999999997e-07 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.767 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034392+0000", 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4737999999999997e-05 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034423+0000", 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0831999999999999e-05 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034452+0000", 2024-09-16T04:08:26.768 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8509000000000001e-05 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034601+0000", 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014930799999999999 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.034626+0000", 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4706e-05 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:26.769 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.039355+0000", 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047292829999999999 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:21.039429+0000", 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3830000000000003e-05 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:289 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.044898+0000", 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.62710776800000001, 2024-09-16T04:08:26.770 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0085620509999999993, 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 289 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044898+0000", 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.771 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044898+0000", 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044900+0000", 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4380000000000002e-06 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044912+0000", 2024-09-16T04:08:26.772 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1827e-05 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044939+0000", 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7223999999999999e-05 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044951+0000", 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1608e-05 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.773 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045035+0000", 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4017999999999994e-05 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045043+0000", 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0940000000000008e-06 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047198+0000", 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0021557630000000002 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.774 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047307+0000", 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000108297 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.053460+0000", 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061527819999999999 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:290 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:08:26.775 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.62702231900000005, 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092576150000000003, 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 290 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.776 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044984+0000", 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0699999999999996e-07 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.777 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044990+0000", 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6370000000000002e-06 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045001+0000", 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0253e-05 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045008+0000", 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5179999999999998e-06 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.778 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045111+0000", 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102534 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045116+0000", 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047750+0000", 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026333289999999998 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.779 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047840+0000", 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0716000000000004e-05 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.054241+0000", 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064002479999999999 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:291 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:08:26.780 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.62698590200000004, 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010030295999999999, 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 291 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:08:26.781 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045020+0000", 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8100000000000003e-07 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:26.782 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045024+0000", 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8580000000000002e-06 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045032+0000", 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3310000000000004e-06 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045039+0000", 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6320000000000002e-06 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.783 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045164+0000", 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012537599999999999 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045172+0000", 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5750000000000003e-06 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048140+0000", 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029680029999999999 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:26.784 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048205+0000", 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5269000000000001e-05 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.055050+0000", 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068446710000000001 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:26.785 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:26.787 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:26.787 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:26.787+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:26.888 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:26.883+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:26.923 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:26.923 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:26.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:08:26.989 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:26.983+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:27.010 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-16T04:08:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T04:08:27.017 INFO:tasks.rados.rados.0.smithi204.stdout:110: done (3 left) 2024-09-16T04:08:27.017 INFO:tasks.rados.rados.0.smithi204.stdout:112: done (2 left) 2024-09-16T04:08:27.017 INFO:tasks.rados.rados.0.smithi204.stdout:113: done (1 left) 2024-09-16T04:08:27.017 INFO:tasks.rados.rados.0.smithi204.stdout:114: done (0 left) 2024-09-16T04:08:27.017 INFO:tasks.rados.rados.0.smithi204.stdout:115: rollback oid 43 current snap is 6 2024-09-16T04:08:27.017 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 43 to 4 2024-09-16T04:08:27.018 INFO:tasks.rados.rados.0.smithi204.stdout:116: rollback oid 28 current snap is 6 2024-09-16T04:08:27.018 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 28 to 5 2024-09-16T04:08:27.018 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 44 current snap is 6 2024-09-16T04:08:27.018 INFO:tasks.rados.rados.0.smithi204.stdout:117: seq_num 74 ranges {737280=475136,1212416=622592,1835008=147456} 2024-09-16T04:08:27.032 INFO:tasks.rados.rados.0.smithi204.stdout:117: writing smithi20431790-44 from 737280 to 1212416 tid 1 2024-09-16T04:08:27.037 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-16T04:08:27.040 INFO:tasks.rados.rados.0.smithi204.stdout:117: writing smithi20431790-44 from 1212416 to 1835008 tid 2 2024-09-16T04:08:27.043 INFO:tasks.rados.rados.0.smithi204.stdout:117: writing smithi20431790-44 from 1835008 to 1982464 tid 3 2024-09-16T04:08:27.043 INFO:tasks.rados.rados.0.smithi204.stdout:118: rollback oid 6 current snap is 6 2024-09-16T04:08:27.044 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 6 to 5 2024-09-16T04:08:27.044 INFO:tasks.rados.rados.0.smithi204.stdout:119: copy_from oid 20 from oid 5 current snap is 6 2024-09-16T04:08:27.044 INFO:tasks.rados.rados.0.smithi204.stdout:115: finishing rollback tid 0 to smithi20431790-43 2024-09-16T04:08:27.044 INFO:tasks.rados.rados.0.smithi204.stdout:115: finishing rollback tid 1 to smithi20431790-43 2024-09-16T04:08:27.044 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 1 current snap is 6 2024-09-16T04:08:27.044 INFO:tasks.rados.rados.0.smithi204.stdout:120: seq_num 75 ranges {32768=491520,524288=770048} 2024-09-16T04:08:27.050 INFO:tasks.rados.rados.0.smithi204.stdout:120: writing smithi20431790-1 from 32768 to 524288 tid 1 2024-09-16T04:08:27.061 INFO:tasks.rados.rados.0.smithi204.stdout:120: writing smithi20431790-1 from 524288 to 1294336 tid 2 2024-09-16T04:08:27.061 INFO:tasks.rados.rados.0.smithi204.stdout:121: snap_create 2024-09-16T04:08:27.061 INFO:tasks.rados.rados.0.smithi204.stdout:115: finishing rollback tid 2 to smithi20431790-43 2024-09-16T04:08:27.061 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 43 v 30 (ObjNum 53 snap 1 seq_num 53) dirty exists 2024-09-16T04:08:27.061 INFO:tasks.rados.rados.0.smithi204.stdout:116: finishing rollback tid 0 to smithi20431790-28 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:117: finishing write tid 1 to smithi20431790-44 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:116: finishing rollback tid 1 to smithi20431790-28 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:116: finishing rollback tid 2 to smithi20431790-28 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 28 v 34 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:118: finishing rollback tid 1 to smithi20431790-6 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 6 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:117: finishing write tid 2 to smithi20431790-44 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:117: finishing write tid 3 to smithi20431790-44 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:119: finishing copy_from racing read to smithi20431790-20 2024-09-16T04:08:27.062 INFO:tasks.rados.rados.0.smithi204.stdout:117: finishing write tid 4 to smithi20431790-44 2024-09-16T04:08:27.063 INFO:tasks.rados.rados.0.smithi204.stdout:119: finishing copy_from to smithi20431790-20 2024-09-16T04:08:27.063 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 20 v 2 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:08:27.064 INFO:tasks.rados.rados.0.smithi204.stdout:120: finishing write tid 1 to smithi20431790-1 2024-09-16T04:08:27.073 INFO:tasks.rados.rados.0.smithi204.stdout:120: finishing write tid 2 to smithi20431790-1 2024-09-16T04:08:27.073 INFO:tasks.rados.rados.0.smithi204.stdout:120: finishing write tid 3 to smithi20431790-1 2024-09-16T04:08:27.073 INFO:tasks.rados.rados.0.smithi204.stdout:117: finishing write tid 5 to smithi20431790-44 2024-09-16T04:08:27.073 INFO:tasks.rados.rados.0.smithi204.stdout:117: oid 44 updating version 0 to 9 2024-09-16T04:08:27.073 INFO:tasks.rados.rados.0.smithi204.stdout:117: oid 44 updating version 9 to 11 2024-09-16T04:08:27.073 INFO:tasks.rados.rados.0.smithi204.stdout:117: oid 44 version 11 is already newer than 8 2024-09-16T04:08:27.074 INFO:tasks.rados.rados.0.smithi204.stdout:117: oid 44 version 11 is already newer than 10 2024-09-16T04:08:27.074 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 11 (ObjNum 74 snap 6 seq_num 74) dirty exists 2024-09-16T04:08:27.074 INFO:tasks.rados.rados.0.smithi204.stdout:117: left oid 44 (ObjNum 74 snap 6 seq_num 74) 2024-09-16T04:08:27.076 INFO:tasks.rados.rados.0.smithi204.stdout:120: finishing write tid 4 to smithi20431790-1 2024-09-16T04:08:27.076 INFO:tasks.rados.rados.0.smithi204.stdout:120: oid 1 updating version 0 to 31 2024-09-16T04:08:27.076 INFO:tasks.rados.rados.0.smithi204.stdout:120: oid 1 version 31 is already newer than 29 2024-09-16T04:08:27.077 INFO:tasks.rados.rados.0.smithi204.stdout:120: oid 1 version 31 is already newer than 30 2024-09-16T04:08:27.077 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 1 v 31 (ObjNum 75 snap 6 seq_num 75) dirty exists 2024-09-16T04:08:27.077 INFO:tasks.rados.rados.0.smithi204.stdout:120: left oid 1 (ObjNum 75 snap 6 seq_num 75) 2024-09-16T04:08:27.088 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:27.088 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:27.090 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:27.086+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:27.107 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:08:27.191 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:27.187+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:27.272 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:30 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'16, mlcod=25'14)", 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:01.808761+0000", 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.461875232000001, 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002884625, 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808761+0000", 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808761+0000", 2024-09-16T04:08:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808763+0000", 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8700000000000001e-06 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808790+0000", 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7171000000000001e-05 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808820+0000", 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9516999999999999e-05 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808833+0000", 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3129000000000001e-05 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.808970+0000", 2024-09-16T04:08:27.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136861 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.809022+0000", 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2448999999999999e-05 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.811535+0000", 2024-09-16T04:08:27.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025124050000000001 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.811646+0000", 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111223 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:33 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'19, mlcod=25'14)", 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:01.810414+0000", 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.460222078000001, 2024-09-16T04:08:27.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002812471, 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810414+0000", 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810414+0000", 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810416+0000", 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.813e-06 2024-09-16T04:08:27.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810428+0000", 2024-09-16T04:08:27.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1749000000000001e-05 2024-09-16T04:08:27.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810451+0000", 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3484000000000001e-05 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810464+0000", 2024-09-16T04:08:27.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2839e-05 2024-09-16T04:08:27.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810913+0000", 2024-09-16T04:08:27.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044906900000000002 2024-09-16T04:08:27.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.810963+0000", 2024-09-16T04:08:27.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9456000000000002e-05 2024-09-16T04:08:27.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.813134+0000", 2024-09-16T04:08:27.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021710829999999999 2024-09-16T04:08:27.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:01.813227+0000", 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2978000000000003e-05 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.287 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:140 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'98, mlcod=25'93)", 2024-09-16T04:08:27.287 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.268947+0000", 2024-09-16T04:08:27.287 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.001688947000002, 2024-09-16T04:08:27.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002898009, 2024-09-16T04:08:27.287 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.288 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.288 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.288 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.268947+0000", 2024-09-16T04:08:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.268947+0000", 2024-09-16T04:08:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.268949+0000", 2024-09-16T04:08:27.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3459999999999999e-06 2024-09-16T04:08:27.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269002+0000", 2024-09-16T04:08:27.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3075999999999998e-05 2024-09-16T04:08:27.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269021+0000", 2024-09-16T04:08:27.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9590999999999999e-05 2024-09-16T04:08:27.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269032+0000", 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029000000000001e-05 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269154+0000", 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121326 2024-09-16T04:08:27.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269209+0000", 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5010999999999999e-05 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.271760+0000", 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025515109999999998 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.271845+0000", 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5118999999999996e-05 2024-09-16T04:08:27.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:178 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'128, mlcod=25'125)", 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.681263049999998, 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040807439999999999, 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.295 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589375+0000", 2024-09-16T04:08:27.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8059999999999999e-06 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589392+0000", 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7215e-05 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589423+0000", 2024-09-16T04:08:27.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0893999999999999e-05 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589449+0000", 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6084e-05 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589544+0000", 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4752000000000004e-05 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589575+0000", 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0914000000000003e-05 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593350+0000", 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037747520000000001 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593454+0000", 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010432700000000001 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:179 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'129, mlcod=25'125)", 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.680816190000002, 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037140540000000001, 2024-09-16T04:08:27.300 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589822+0000", 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5099999999999999e-06 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589904+0000", 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1948999999999998e-05 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589932+0000", 2024-09-16T04:08:27.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8768e-05 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589950+0000", 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7484999999999999e-05 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590036+0000", 2024-09-16T04:08:27.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6421999999999994e-05 2024-09-16T04:08:27.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590068+0000", 2024-09-16T04:08:27.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1324e-05 2024-09-16T04:08:27.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593460+0000", 2024-09-16T04:08:27.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033925349999999999 2024-09-16T04:08:27.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593534+0000", 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4060999999999994e-05 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:180 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'130, mlcod=25'125)", 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.680240801, 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048385040000000004, 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590397+0000", 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:08:27.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590411+0000", 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4019000000000001e-05 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590437+0000", 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5604000000000001e-05 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590471+0000", 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786999999999997e-05 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590878+0000", 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040631400000000001 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590911+0000", 2024-09-16T04:08:27.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595170+0000", 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042592050000000003 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595234+0000", 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3921e-05 2024-09-16T04:08:27.312 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:181 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'131, mlcod=25'125)", 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.679835911000001, 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044790569999999998, 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.313 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590802+0000", 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5370000000000001e-06 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590815+0000", 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2622e-05 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590841+0000", 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5914999999999998e-05 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590857+0000", 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6430999999999999e-05 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591464+0000", 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060738700000000003 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591494+0000", 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9467000000000001e-05 2024-09-16T04:08:27.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595239+0000", 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037453709999999999 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595279+0000", 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0327000000000002e-05 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:182 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'132, mlcod=25'125)", 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.679326966000001, 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051456440000000004, 2024-09-16T04:08:27.319 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591311+0000", 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7439999999999999e-06 2024-09-16T04:08:27.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591380+0000", 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8540000000000004e-05 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591407+0000", 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7830999999999998e-05 2024-09-16T04:08:27.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591427+0000", 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9689000000000001e-05 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592031+0000", 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060361900000000001 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592059+0000", 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8603999999999999e-05 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596398+0000", 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043381060000000004 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596455+0000", 2024-09-16T04:08:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7510999999999999e-05 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:183 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'133, mlcod=25'125)", 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.678824995999999, 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046844299999999998, 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.325 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591813+0000", 2024-09-16T04:08:27.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5990000000000001e-06 2024-09-16T04:08:27.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591827+0000", 2024-09-16T04:08:27.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4012000000000001e-05 2024-09-16T04:08:27.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591851+0000", 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3785e-05 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591867+0000", 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6184999999999998e-05 2024-09-16T04:08:27.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592788+0000", 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092107500000000004 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592818+0000", 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0487000000000001e-05 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596460+0000", 2024-09-16T04:08:27.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036418240000000001 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596496+0000", 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5463000000000002e-05 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:184 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'134, mlcod=25'126)", 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.677992289999999, 2024-09-16T04:08:27.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039075459999999996, 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592646+0000", 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5689999999999999e-06 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592687+0000", 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0890000000000003e-05 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592714+0000", 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7433999999999999e-05 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592752+0000", 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7703000000000001e-05 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593624+0000", 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087221300000000005 2024-09-16T04:08:27.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593657+0000", 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596500+0000", 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028428279999999999 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596552+0000", 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1755000000000002e-05 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:185 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'135, mlcod=25'126)", 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.677426493999999, 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004807703, 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.336 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593211+0000", 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593283+0000", 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1697000000000002e-05 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593310+0000", 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7427999999999999e-05 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593326+0000", 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6121e-05 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594218+0000", 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089172399999999999 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594251+0000", 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3093999999999999e-05 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597952+0000", 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037006389999999999 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598018+0000", 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5640000000000002e-05 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.341 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:186 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'136, mlcod=25'126)", 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.676914580000002, 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043516780000000003, 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:27.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593723+0000", 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.674e-06 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593735+0000", 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1844999999999999e-05 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593766+0000", 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0491e-05 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593785+0000", 2024-09-16T04:08:27.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9585e-05 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595361+0000", 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015760870000000001 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595391+0000", 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9974000000000001e-05 2024-09-16T04:08:27.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598023+0000", 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00263138 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598073+0000", 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0642000000000001e-05 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:187 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'137, mlcod=25'126)", 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.676525977000001, 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040215060000000002, 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594112+0000", 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594125+0000", 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2928000000000001e-05 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594151+0000", 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5860999999999999e-05 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594167+0000", 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6458999999999999e-05 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595892+0000", 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017252299999999999 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595937+0000", 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4246000000000003e-05 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598075+0000", 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002138821 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598132+0000", 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6461e-05 2024-09-16T04:08:27.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:188 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'138, mlcod=25'128)", 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.594947+0000", 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.675689248000001, 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003368308, 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.352 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594947+0000", 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594947+0000", 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594948+0000", 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.376e-06 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595018+0000", 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9534000000000002e-05 2024-09-16T04:08:27.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595045+0000", 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7325e-05 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595062+0000", 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6770999999999999e-05 2024-09-16T04:08:27.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596662+0000", 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015996980000000001 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596704+0000", 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1773000000000001e-05 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598201+0000", 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014978979999999999 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598315+0000", 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011393299999999999 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:189 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'139, mlcod=25'128)", 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.595512+0000", 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.675124798999999, 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034970940000000001, 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595512+0000", 2024-09-16T04:08:27.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595512+0000", 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595513+0000", 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7069999999999999e-06 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595525+0000", 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829e-05 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595558+0000", 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3080000000000002e-05 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595576+0000", 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7382999999999999e-05 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597516+0000", 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019402040000000001 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597548+0000", 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2437000000000001e-05 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598929+0000", 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001381141 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.599009+0000", 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9313000000000004e-05 2024-09-16T04:08:27.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es5 33/31 ECSubWrite(tid=0, reqid=client.4631.0:4, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.933631+0000", 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.337004886999999, 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028023259999999999, 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933631+0000", 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933631+0000", 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933633+0000", 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.922e-06 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933680+0000", 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6898999999999999e-05 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933712+0000", 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1798999999999998e-05 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933727+0000", 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4622e-05 2024-09-16T04:08:27.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933832+0000", 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010517 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933844+0000", 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1703e-05 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936330+0000", 2024-09-16T04:08:27.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024866900000000002 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936434+0000", 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103521 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.330057872999999, 2024-09-16T04:08:27.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055770669999999998, 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940579+0000", 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7e-07 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940742+0000", 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343299999999999 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940766+0000", 2024-09-16T04:08:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3288000000000001e-05 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940779+0000", 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3254999999999999e-05 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0068000000000007e-05 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:27.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940868+0000", 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8170000000000005e-06 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946112+0000", 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052441359999999999 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946156+0000", 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3600000000000003e-05 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.329826809, 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047930250000000002, 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940832+0000", 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1430999999999999e-05 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940851+0000", 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8941e-05 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9100000000000005e-06 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940937+0000", 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8448999999999994e-05 2024-09-16T04:08:27.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940947+0000", 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.012e-05 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945554+0000", 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046069070000000004 2024-09-16T04:08:27.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945603+0000", 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8401e-05 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:27.377 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.329106041999999, 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046535999999999999, 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941531+0000", 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.127e-06 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941561+0000", 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0011000000000001e-05 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941630+0000", 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8071999999999995e-05 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941642+0000", 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2785e-05 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941714+0000", 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1396000000000006e-05 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941729+0000", 2024-09-16T04:08:27.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5656999999999999e-05 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946160+0000", 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044310349999999998 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946184+0000", 2024-09-16T04:08:27.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3516999999999999e-05 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.328386815, 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039380309999999998, 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:27.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:27.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942275+0000", 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4142999999999999e-05 2024-09-16T04:08:27.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942290+0000", 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4929000000000001e-05 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942299+0000", 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8190000000000003e-06 2024-09-16T04:08:27.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942409+0000", 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109419 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942417+0000", 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539999999999992e-06 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:27.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946142+0000", 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037254079999999999 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946188+0000", 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5123999999999997e-05 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:27.388 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:27.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:08:27.391 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:27.387+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:27.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:27.491 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:27.487+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:27.512 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:27.513 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:27.513 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:27.513 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:27.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:08:27.592 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:27.587+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:27.594 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:27.594 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:27.615 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:27.637 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:27.637 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:27.646 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:27.647 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:27.658 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:27.659 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:27.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:08:27.676 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:27.676 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:27.692 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:27.689+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:27.696 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:27.717 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:27.718 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:27.739 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:27.739 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:27.757 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:27.757 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:27.778 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:27.778 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:27.778 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:27.778 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:27.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:08:27.799 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:27.800 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:27.798+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:27.820 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:27.820 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:27.836 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:27.837 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:27.860 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:27.860 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:27.878 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:27.879 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:27.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:27.878+0000 7fce6e0c1640 0 -- 172.21.15.32:0/3258618730 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7fce68224060 msgr2=0x7fce68226450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:27.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:27.891+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:27.921 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:27.922 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:27.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:08:27.994 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:27.995+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.4 to 1 (10000) 2024-09-16T04:08:28.032 INFO:tasks.rados.rados.0.smithi204.stdout:115: done (6 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:116: done (5 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:117: done (4 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:118: done (3 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:119: done (2 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:120: done (1 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:121: done (0 left) 2024-09-16T04:08:28.033 INFO:tasks.rados.rados.0.smithi204.stdout:122: setattr oid 19 current snap is 7 2024-09-16T04:08:28.037 INFO:tasks.rados.rados.0.smithi204.stdout:123: rollback oid 34 current snap is 7 2024-09-16T04:08:28.037 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 34 to 5 2024-09-16T04:08:28.037 INFO:tasks.rados.rados.0.smithi204.stdout:124: copy_from oid 29 from oid 25 current snap is 7 2024-09-16T04:08:28.038 INFO:tasks.rados.rados.0.smithi204.stdout:125: read oid 17 snap -1 2024-09-16T04:08:28.038 INFO:tasks.rados.rados.0.smithi204.stdout:125: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-16T04:08:28.038 INFO:tasks.rados.rados.0.smithi204.stdout:126: read oid 38 snap -1 2024-09-16T04:08:28.038 INFO:tasks.rados.rados.0.smithi204.stdout:126: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-16T04:08:28.038 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 30 current snap is 7 2024-09-16T04:08:28.038 INFO:tasks.rados.rados.0.smithi204.stdout:127: seq_num 76 ranges {1327104=507904,1835008=507904,2342912=262144} 2024-09-16T04:08:28.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-16T04:08:28.061 INFO:tasks.rados.rados.0.smithi204.stdout:127: writing smithi20431790-30 from 1327104 to 1835008 tid 1 2024-09-16T04:08:28.067 INFO:tasks.rados.rados.0.smithi204.stdout:127: writing smithi20431790-30 from 1835008 to 2342912 tid 2 2024-09-16T04:08:28.070 INFO:tasks.rados.rados.0.smithi204.stdout:127: writing smithi20431790-30 from 2342912 to 2605056 tid 3 2024-09-16T04:08:28.071 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 40 current snap is 7 2024-09-16T04:08:28.071 INFO:tasks.rados.rados.0.smithi204.stdout:128: seq_num 77 ranges {671744=524288,1196032=524288,1720320=245760} 2024-09-16T04:08:28.084 INFO:tasks.rados.rados.0.smithi204.stdout:128: writing smithi20431790-40 from 671744 to 1196032 tid 1 2024-09-16T04:08:28.090 INFO:tasks.rados.rados.0.smithi204.stdout:128: writing smithi20431790-40 from 1196032 to 1720320 tid 2 2024-09-16T04:08:28.093 INFO:tasks.rados.rados.0.smithi204.stdout:128: writing smithi20431790-40 from 1720320 to 1966080 tid 3 2024-09-16T04:08:28.093 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 49 current snap is 7 2024-09-16T04:08:28.093 INFO:tasks.rados.rados.0.smithi204.stdout:129: seq_num 78 ranges {819200=557056,1376256=671744,2048000=98304} 2024-09-16T04:08:28.095 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:28.093+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:28.105 INFO:tasks.rados.rados.0.smithi204.stdout:129: writing smithi20431790-49 from 819200 to 1376256 tid 1 2024-09-16T04:08:28.110 INFO:tasks.rados.rados.0.smithi204.stdout:129: writing smithi20431790-49 from 1376256 to 2048000 tid 2 2024-09-16T04:08:28.111 INFO:tasks.rados.rados.0.smithi204.stdout:129: writing smithi20431790-49 from 2048000 to 2146304 tid 3 2024-09-16T04:08:28.111 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 22 current snap is 7 2024-09-16T04:08:28.111 INFO:tasks.rados.rados.0.smithi204.stdout:130: seq_num 79 ranges {360448=573440,933888=425984,1359872=344064} 2024-09-16T04:08:28.118 INFO:tasks.rados.rados.0.smithi204.stdout:130: writing smithi20431790-22 from 360448 to 933888 tid 1 2024-09-16T04:08:28.119 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:28.120 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:28.122 INFO:tasks.rados.rados.0.smithi204.stdout:130: writing smithi20431790-22 from 933888 to 1359872 tid 2 2024-09-16T04:08:28.124 INFO:tasks.rados.rados.0.smithi204.stdout:130: writing smithi20431790-22 from 1359872 to 1703936 tid 3 2024-09-16T04:08:28.125 INFO:tasks.rados.rados.0.smithi204.stdout:131: rollback oid 20 current snap is 7 2024-09-16T04:08:28.125 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 20 to 6 2024-09-16T04:08:28.125 INFO:tasks.rados.rados.0.smithi204.stdout:125: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-16T04:08:28.136 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:28.137 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:28.147 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 19 v 49 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-16T04:08:28.147 INFO:tasks.rados.rados.0.smithi204.stdout:123: finishing rollback tid 0 to smithi20431790-34 2024-09-16T04:08:28.147 INFO:tasks.rados.rados.0.smithi204.stdout:126: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-16T04:08:28.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:08:28.186 INFO:tasks.rados.rados.0.smithi204.stdout:123: finishing rollback tid 1 to smithi20431790-34 2024-09-16T04:08:28.186 INFO:tasks.rados.rados.0.smithi204.stdout:123: finishing rollback tid 2 to smithi20431790-34 2024-09-16T04:08:28.186 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 34 v 10 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:124: finishing copy_from racing read to smithi20431790-29 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: finishing write tid 1 to smithi20431790-30 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:124: finishing copy_from to smithi20431790-29 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 29 v 4 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: finishing write tid 2 to smithi20431790-30 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: finishing write tid 3 to smithi20431790-30 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: finishing write tid 4 to smithi20431790-30 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:128: finishing write tid 1 to smithi20431790-40 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:128: finishing write tid 2 to smithi20431790-40 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: finishing write tid 5 to smithi20431790-30 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: oid 30 updating version 0 to 51 2024-09-16T04:08:28.187 INFO:tasks.rados.rados.0.smithi204.stdout:127: oid 30 updating version 51 to 54 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:127: oid 30 updating version 54 to 55 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:127: oid 30 updating version 55 to 56 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 56 (ObjNum 76 snap 7 seq_num 76) dirty exists 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:127: left oid 30 (ObjNum 76 snap 7 seq_num 76) 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: finishing write tid 3 to smithi20431790-40 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: finishing write tid 4 to smithi20431790-40 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: finishing write tid 5 to smithi20431790-40 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: oid 40 updating version 0 to 17 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: oid 40 version 17 is already newer than 16 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: oid 40 updating version 17 to 18 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: oid 40 updating version 18 to 19 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 40 v 19 (ObjNum 77 snap 7 seq_num 77) dirty exists 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:128: left oid 40 (ObjNum 77 snap 7 seq_num 77) 2024-09-16T04:08:28.188 INFO:tasks.rados.rados.0.smithi204.stdout:129: finishing write tid 1 to smithi20431790-49 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:129: finishing write tid 2 to smithi20431790-49 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:129: finishing write tid 3 to smithi20431790-49 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:122: done (9 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:123: done (8 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:124: done (7 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:125: done (6 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:126: done (5 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:127: done (4 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:128: done (3 left) 2024-09-16T04:08:28.189 INFO:tasks.rados.rados.0.smithi204.stdout:132: copy_from oid 3 from oid 39 current snap is 7 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: finishing write tid 4 to smithi20431790-49 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:130: finishing write tid 1 to smithi20431790-22 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: finishing write tid 5 to smithi20431790-49 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: oid 49 updating version 0 to 34 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: oid 49 version 34 is already newer than 33 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: oid 49 updating version 34 to 36 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: oid 49 version 36 is already newer than 35 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 36 (ObjNum 78 snap 7 seq_num 78) dirty exists 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:129: left oid 49 (ObjNum 78 snap 7 seq_num 78) 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:130: finishing write tid 2 to smithi20431790-22 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:130: finishing write tid 3 to smithi20431790-22 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:130: finishing write tid 4 to smithi20431790-22 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:131: finishing rollback tid 0 to smithi20431790-20 2024-09-16T04:08:28.190 INFO:tasks.rados.rados.0.smithi204.stdout:131: finishing rollback tid 1 to smithi20431790-20 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:130: finishing write tid 5 to smithi20431790-22 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:130: oid 22 updating version 0 to 16 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:130: oid 22 updating version 16 to 19 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:130: oid 22 version 19 is already newer than 17 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:130: oid 22 version 19 is already newer than 18 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 22 v 19 (ObjNum 79 snap 7 seq_num 79) dirty exists 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:130: left oid 22 (ObjNum 79 snap 7 seq_num 79) 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:131: finishing rollback tid 2 to smithi20431790-20 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 20 v 23 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:08:28.191 INFO:tasks.rados.rados.0.smithi204.stdout:129: done (3 left) 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:130: done (2 left) 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:131: done (1 left) 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:133: read oid 11 snap -1 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:133: expect deleted 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:134: delete oid 50 current snap is 7 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:133: done (2 left) 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:134: done (1 left) 2024-09-16T04:08:28.192 INFO:tasks.rados.rados.0.smithi204.stdout:135: snap_remove snap 6 2024-09-16T04:08:28.196 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:28.191+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:28.297 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:28.293+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:28.312 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:28.312 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:28.325 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:08:28.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:28.395+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:28.449 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:28.449 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:28.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:08:28.499 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:28.495+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:28.590 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:28.591 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:28.599 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:28.598+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:28.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:08:28.700 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:28.698+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:28.776 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:28.776 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:28.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:08:28.834 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:28.833+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:28.902 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:28.899+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:28.923 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:28.923 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:28.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:08:29.031 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:29.029+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:29.034 INFO:tasks.rados.rados.0.smithi204.stdout:135: done (1 left) 2024-09-16T04:08:29.034 INFO:tasks.rados.rados.0.smithi204.stdout:136: read oid 7 snap -1 2024-09-16T04:08:29.034 INFO:tasks.rados.rados.0.smithi204.stdout:136: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-16T04:08:29.034 INFO:tasks.rados.rados.0.smithi204.stdout:137: snap_create 2024-09-16T04:08:29.034 INFO:tasks.rados.rados.0.smithi204.stdout:132: finishing copy_from racing read to smithi20431790-3 2024-09-16T04:08:29.035 INFO:tasks.rados.rados.0.smithi204.stdout:132: finishing copy_from to smithi20431790-3 2024-09-16T04:08:29.035 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 3 v 2 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-16T04:08:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-09-16T04:08:29.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-16T04:08:29.054 INFO:tasks.rados.rados.0.smithi204.stdout:136: expect (ObjNum 6 snap 0 seq_num 6) 2024-09-16T04:08:29.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-16T04:08:29.104 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:29.099+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:29.124 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:29.124 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:29.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:08:29.206 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:29.203+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:29.306 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:29.305+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:29.310 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:29.310 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:29.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:08:29.408 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:29.406+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:29.487 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:29.487 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:29.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:08:29.509 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:29.507+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:29.610 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:29.607+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:29.623 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:29.623 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:29.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:08:29.711 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:29.707+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:29.763 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:29.763 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:29.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:08:29.822 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:29.821+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:29.834 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-09-16T04:08:29.835 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-16T04:08:29.838 INFO:tasks.rados.rados.0.smithi204.stdout:132: done (2 left) 2024-09-16T04:08:29.838 INFO:tasks.rados.rados.0.smithi204.stdout:136: done (1 left) 2024-09-16T04:08:29.838 INFO:tasks.rados.rados.0.smithi204.stdout:137: done (0 left) 2024-09-16T04:08:29.838 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 7 current snap is 8 2024-09-16T04:08:29.839 INFO:tasks.rados.rados.0.smithi204.stdout:138: seq_num 81 ranges {114688=606208,720896=720896,1441792=49152} 2024-09-16T04:08:29.847 INFO:tasks.rados.rados.0.smithi204.stdout:138: writing smithi20431790-7 from 114688 to 720896 tid 1 2024-09-16T04:08:29.857 INFO:tasks.rados.rados.0.smithi204.stdout:138: writing smithi20431790-7 from 720896 to 1441792 tid 2 2024-09-16T04:08:29.858 INFO:tasks.rados.rados.0.smithi204.stdout:138: writing smithi20431790-7 from 1441792 to 1490944 tid 3 2024-09-16T04:08:29.858 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 32 current snap is 8 2024-09-16T04:08:29.858 INFO:tasks.rados.rados.0.smithi204.stdout:139: seq_num 82 ranges {163840=622592,786432=475136,1261568=294912} 2024-09-16T04:08:29.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-16T04:08:29.869 INFO:tasks.rados.rados.0.smithi204.stdout:139: writing smithi20431790-32 from 163840 to 786432 tid 1 2024-09-16T04:08:29.876 INFO:tasks.rados.rados.0.smithi204.stdout:139: writing smithi20431790-32 from 786432 to 1261568 tid 2 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:139: writing smithi20431790-32 from 1261568 to 1556480 tid 3 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:140: rollback oid 37 current snap is 8 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 37 to 4 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:138: finishing write tid 1 to smithi20431790-7 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:138: finishing write tid 2 to smithi20431790-7 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:138: finishing write tid 3 to smithi20431790-7 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:138: finishing write tid 4 to smithi20431790-7 2024-09-16T04:08:29.881 INFO:tasks.rados.rados.0.smithi204.stdout:138: finishing write tid 5 to smithi20431790-7 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:138: oid 7 updating version 0 to 17 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:138: oid 7 version 17 is already newer than 14 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:138: oid 7 version 17 is already newer than 16 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:138: oid 7 version 17 is already newer than 15 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 7 v 17 (ObjNum 81 snap 8 seq_num 81) dirty exists 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:138: left oid 7 (ObjNum 81 snap 8 seq_num 81) 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:138: done (2 left) 2024-09-16T04:08:29.882 INFO:tasks.rados.rados.0.smithi204.stdout:141: snap_remove snap 5 2024-09-16T04:08:29.909 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:29.909 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:29.912 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:29.907+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:29.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:08:30.014 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:30.011+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:30.085 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:30.085 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:30.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:08:30.114 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:30.111+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:30.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:30.215 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:30.213+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:30.227 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:30.227 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:30.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:08:30.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:30.292 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:30.312 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:30.312 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:30.330 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:30.329+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:30.335 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:30.335 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:30.358 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:30.358 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:30.378 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:30.401 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:30.401 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:30.416 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:30.417 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:30.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:30.415+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:30.425 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:30.426 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:30.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:08:30.450 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:30.450 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:30.470 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:30.471 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:30.491 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:30.491 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:30.515 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:30.516 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:30.522 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:30.519+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:30.540 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:30.540 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:30.562 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:30.562 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:30.587 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:30.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:30.602 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:30.602 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:30.602 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:30.602 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:30.602 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:30.613 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:30.613 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:30.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:08:30.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:30.618+0000 7fd2e77fe640 0 -- 172.21.15.32:0/3866735783 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7fd2e8223d40 msgr2=0x7fd2e8226130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:30.623 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:30.623+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:30.646 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:30.646 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:30.725 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:30.723+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:8 3.as0 3:52d8912d:::smithi20431790-3:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934014+0000", 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.808253158999999, 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017053859000000001, 2024-09-16T04:08:30.744 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 8 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934014+0000", 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934014+0000", 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.626e-06 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934026+0000", 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0482999999999999e-05 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934047+0000", 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1375000000000001e-05 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934065+0000", 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7640999999999999e-05 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937962+0000", 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038972210000000002 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938198+0000", 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023572999999999999 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940446+0000", 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022479750000000001 2024-09-16T04:08:30.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949229+0000", 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087831780000000009 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949384+0000", 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000155604 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951067+0000", 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001683026 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.751 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:9 3.as0 3:52d8912d:::smithi20431790-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.808175553, 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.032735913999999998, 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 9 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934092+0000", 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3170000000000001e-06 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934099+0000", 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.37e-06 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934121+0000", 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2124999999999999e-05 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934137+0000", 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6464999999999999e-05 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941032+0000", 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068944719999999996 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941265+0000", 2024-09-16T04:08:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233105 2024-09-16T04:08:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952818+0000", 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011552529000000001 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.953039+0000", 2024-09-16T04:08:30.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221089 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.966827+0000", 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013788442 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s2 33/31 ECSubWrite(tid=158, reqid=client.4631.0:10, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.935351+0000", 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.806915811, 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016703684999999999, 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935351+0000", 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935351+0000", 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935352+0000", 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0299999999999998e-07 2024-09-16T04:08:30.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935453+0000", 2024-09-16T04:08:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101402 2024-09-16T04:08:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935488+0000", 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5110000000000001e-05 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935512+0000", 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3671000000000001e-05 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941368+0000", 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058558430000000003 2024-09-16T04:08:30.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941388+0000", 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0528999999999999e-05 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951977+0000", 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010588433 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952055+0000", 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7993999999999999e-05 2024-09-16T04:08:30.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:19 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~114688,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.804888451, 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019793136999999999, 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 19 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:30.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937381+0000", 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.633e-06 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937660+0000", 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027928000000000002 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5524000000000001e-05 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937718+0000", 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2602000000000001e-05 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937890+0000", 2024-09-16T04:08:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017148200000000001 2024-09-16T04:08:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938217+0000", 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032706899999999998 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940124+0000", 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001907143 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948870+0000", 2024-09-16T04:08:30.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087458320000000003 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956986+0000", 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0081158810000000001 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957171+0000", 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018569100000000001 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:20 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.803664906, 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020600382, 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 20 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938604+0000", 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9659999999999999e-06 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938616+0000", 2024-09-16T04:08:30.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1992e-05 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938643+0000", 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7447999999999999e-05 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9269000000000001e-05 2024-09-16T04:08:30.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941338+0000", 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002675242 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941576+0000", 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023854 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943570+0000", 2024-09-16T04:08:30.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019934800000000002 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949041+0000", 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005471722 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958969+0000", 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099272460000000007 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959202+0000", 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233477 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:21 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.803556965, 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028407564999999999, 2024-09-16T04:08:30.777 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 21 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938711+0000", 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4330000000000001e-06 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938719+0000", 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3189999999999995e-06 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938743+0000", 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3645000000000001e-05 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938782+0000", 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9013000000000001e-05 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944592+0000", 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005810267 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944817+0000", 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000224904 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960092+0000", 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015274846 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960315+0000", 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223095 2024-09-16T04:08:30.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967117+0000", 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068020429999999998 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s2 34/31 ECSubWrite(tid=170, reqid=client.4631.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.770717691, 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020104377, 2024-09-16T04:08:30.783 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971551+0000", 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6169999999999999e-06 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971575+0000", 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3878000000000001e-05 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971623+0000", 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8494e-05 2024-09-16T04:08:30.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971641+0000", 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7944e-05 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971835+0000", 2024-09-16T04:08:30.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019388000000000001 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971861+0000", 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6508000000000001e-05 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991592+0000", 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019731027000000002 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991653+0000", 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1029000000000001e-05 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:58 3.as0 3:57bc9072:::smithi20431790-20:head [append 0~327680,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.769554365999999, 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023641881999999999, 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 58 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972715+0000", 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1310000000000002e-06 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973401+0000", 2024-09-16T04:08:30.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068536200000000002 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973436+0000", 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4777000000000003e-05 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973457+0000", 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1047e-05 2024-09-16T04:08:30.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973758+0000", 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000301716 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974093+0000", 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033437899999999999 2024-09-16T04:08:30.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976226+0000", 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021329019999999999 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991758+0000", 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015532035 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044259850000000003 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996354+0000", 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017054799999999999 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:59 3.as0 3:57bc9072:::smithi20431790-20:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.794 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.768758416000001, 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023229295, 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 59 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973510+0000", 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973519+0000", 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9449999999999999e-06 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973678+0000", 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158815 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973702+0000", 2024-09-16T04:08:30.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.461e-05 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977799+0000", 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040967520000000004 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978040+0000", 2024-09-16T04:08:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024069299999999999 2024-09-16T04:08:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979318+0000", 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001278164 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991761+0000", 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012442844999999999 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996561+0000", 2024-09-16T04:08:30.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048005419999999997 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996738+0000", 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017617199999999999 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:60 3.as0 3:57bc9072:::smithi20431790-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:30.801 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.768532752, 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034426401000000002, 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 60 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973736+0000", 2024-09-16T04:08:30.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-06 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973746+0000", 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0056e-05 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973770+0000", 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3966999999999999e-05 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973785+0000", 2024-09-16T04:08:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5512999999999999e-05 2024-09-16T04:08:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979953+0000", 2024-09-16T04:08:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061678890000000002 2024-09-16T04:08:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980244+0000", 2024-09-16T04:08:30.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029044900000000002 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996914+0000", 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016670404999999999 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997079+0000", 2024-09-16T04:08:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165126 2024-09-16T04:08:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008160+0000", 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011081036000000001 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:64 3.as0 3:5581c6e4:::smithi20431790-22:head [append 0~360448,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.809 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.763811924000001, 2024-09-16T04:08:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024425922999999999, 2024-09-16T04:08:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 64 2024-09-16T04:08:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.811 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978458+0000", 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7429999999999998e-06 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979197+0000", 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073908700000000003 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979227+0000", 2024-09-16T04:08:30.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0793999999999997e-05 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979247+0000", 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0078999999999999e-05 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980478+0000", 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012303170000000001 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981002+0000", 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052460899999999999 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990256+0000", 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092540160000000003 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002501+0000", 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012244649 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002743+0000", 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024201600000000001 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002881+0000", 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137613 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:65 3.as0 3:5581c6e4:::smithi20431790-22:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.762984187000001, 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027732105, 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 65 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.818 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979284+0000", 2024-09-16T04:08:30.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.711e-06 2024-09-16T04:08:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979382+0000", 2024-09-16T04:08:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8177999999999994e-05 2024-09-16T04:08:30.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979409+0000", 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6435e-05 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979459+0000", 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0192999999999999e-05 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993281+0000", 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013822302 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993476+0000", 2024-09-16T04:08:30.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019474100000000001 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994583+0000", 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001106473 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003469+0000", 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088860840000000007 2024-09-16T04:08:30.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006865+0000", 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033959749999999999 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007015+0000", 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150013 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:66 3.as0 3:5581c6e4:::smithi20431790-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.762779453, 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.035359943999999997, 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.825 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 66 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:30.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979489+0000", 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5999999999999999e-06 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979496+0000", 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0820000000000001e-06 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979516+0000", 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9779000000000002e-05 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979530+0000", 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4198e-05 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994979+0000", 2024-09-16T04:08:30.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015449176 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995185+0000", 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000206391 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008423+0000", 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013237844 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008619+0000", 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195582 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.014847+0000", 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062282919999999999 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:67 3.ds0 3:bc48267e:::smithi20431790-23:head [append 0~376832,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.760491839, 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020232841000000001, 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.831 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 67 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981785+0000", 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982754+0000", 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096953899999999995 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982787+0000", 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3216999999999997e-05 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982807+0000", 2024-09-16T04:08:30.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9304e-05 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983165+0000", 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035800399999999998 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983490+0000", 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032504399999999997 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985908+0000", 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024180780000000002 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994386+0000", 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084781360000000007 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001861+0000", 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074755220000000001 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002008+0000", 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014632299999999999 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.837 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:68 3.ds0 3:bc48267e:::smithi20431790-23:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982856+0000", 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.759410795000001, 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019565196999999999, 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 68 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982856+0000", 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982856+0000", 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982858+0000", 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.663e-06 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982867+0000", 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7880000000000001e-06 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982891+0000", 2024-09-16T04:08:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3232000000000001e-05 2024-09-16T04:08:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982907+0000", 2024-09-16T04:08:30.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6744000000000001e-05 2024-09-16T04:08:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988117+0000", 2024-09-16T04:08:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052098810000000004 2024-09-16T04:08:30.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988339+0000", 2024-09-16T04:08:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022159299999999999 2024-09-16T04:08:30.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989503+0000", 2024-09-16T04:08:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011639630000000001 2024-09-16T04:08:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994392+0000", 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048887849999999997 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002254+0000", 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078621869999999996 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002421+0000", 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016736100000000001 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.846 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:69 3.ds0 3:bc48267e:::smithi20431790-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.759320471000001, 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028842145999999999, 2024-09-16T04:08:30.847 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 69 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982948+0000", 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-06 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982989+0000", 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1464999999999997e-05 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983013+0000", 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3703999999999999e-05 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983029+0000", 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5843999999999999e-05 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990775+0000", 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077465149999999998 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991025+0000", 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024982599999999998 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003046+0000", 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012021118000000001 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003451+0000", 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040476500000000002 2024-09-16T04:08:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011788+0000", 2024-09-16T04:08:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008337555 2024-09-16T04:08:30.854 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:73 3.fs0 3:f2191a5d:::smithi20431790-25:head [append 0~409600,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.855 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.987622+0000", 2024-09-16T04:08:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.754644545, 2024-09-16T04:08:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018055873, 2024-09-16T04:08:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 73 2024-09-16T04:08:30.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987622+0000", 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987622+0000", 2024-09-16T04:08:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987625+0000", 2024-09-16T04:08:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5790000000000002e-06 2024-09-16T04:08:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988560+0000", 2024-09-16T04:08:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093503900000000003 2024-09-16T04:08:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988593+0000", 2024-09-16T04:08:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3297999999999999e-05 2024-09-16T04:08:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988613+0000", 2024-09-16T04:08:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0143999999999999e-05 2024-09-16T04:08:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988817+0000", 2024-09-16T04:08:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000203957 2024-09-16T04:08:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989141+0000", 2024-09-16T04:08:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032344999999999997 2024-09-16T04:08:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991388+0000", 2024-09-16T04:08:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022469199999999999 2024-09-16T04:08:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001889+0000", 2024-09-16T04:08:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010501719 2024-09-16T04:08:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.005546+0000", 2024-09-16T04:08:30.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003656294 2024-09-16T04:08:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.005678+0000", 2024-09-16T04:08:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132473 2024-09-16T04:08:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.869 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:75 3.fs0 3:f2191a5d:::smithi20431790-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.750125021000001, 2024-09-16T04:08:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019651762999999999, 2024-09-16T04:08:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 75 2024-09-16T04:08:30.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:30.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992143+0000", 2024-09-16T04:08:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-16T04:08:30.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992149+0000", 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1449999999999996e-06 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992169+0000", 2024-09-16T04:08:30.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0169999999999998e-05 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992184+0000", 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4389999999999999e-05 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994919+0000", 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002735754 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995184+0000", 2024-09-16T04:08:30.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000264481 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006682+0000", 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011498441999999999 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006786+0000", 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010324500000000001 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011793+0000", 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005007933 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:308 3.as0 3:57bc9072:::smithi20431790-20:head [copy-from ver 2] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.6977404979999999, 2024-09-16T04:08:30.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020181012000000002, 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 308 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044530+0000", 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8260000000000003e-06 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044545+0000", 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4922999999999999e-05 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044581+0000", 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5763999999999998e-05 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044602+0000", 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1662e-05 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044981+0000", 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378907 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.045271+0000", 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000289945 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.058303+0000", 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013031612999999999 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061763+0000", 2024-09-16T04:08:30.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034603099999999999 2024-09-16T04:08:30.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:30.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064481+0000", 2024-09-16T04:08:30.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002717849 2024-09-16T04:08:30.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064707+0000", 2024-09-16T04:08:30.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022621300000000001 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:309 3.as0 3:57bc9072:::smithi20431790-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:30.887 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.044646+0000", 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.697620535, 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016636337000000001, 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 309 2024-09-16T04:08:30.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044646+0000", 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044646+0000", 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044648+0000", 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.593e-06 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044656+0000", 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6920000000000008e-06 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044681+0000", 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4652e-05 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044698+0000", 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6843000000000001e-05 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.045833+0000", 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001134623 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for blocked object", 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046044+0000", 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000210943 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.060720+0000", 2024-09-16T04:08:30.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014676521999999999 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.060961+0000", 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024117799999999999 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061282+0000", 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032129100000000002 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.893 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.894 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.894 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:30.894 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:30.894 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:30.897 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-09-16T04:08:30.898 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:08:30.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-16T04:08:30.899 INFO:tasks.rados.rados.0.smithi204.stdout:141: done (2 left) 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 13 current snap is 8 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: finishing write tid 1 to smithi20431790-32 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:140: finishing rollback tid 0 to smithi20431790-37 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:140: finishing rollback tid 1 to smithi20431790-37 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: finishing write tid 2 to smithi20431790-32 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:140: finishing rollback tid 2 to smithi20431790-37 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 37 v 19 (ObjNum 57 snap 4 seq_num 57) dirty exists 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: finishing write tid 3 to smithi20431790-32 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: finishing write tid 4 to smithi20431790-32 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: finishing write tid 5 to smithi20431790-32 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: oid 32 updating version 0 to 10 2024-09-16T04:08:30.900 INFO:tasks.rados.rados.0.smithi204.stdout:139: oid 32 updating version 10 to 12 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:139: oid 32 updating version 12 to 13 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:139: oid 32 version 13 is already newer than 11 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 32 v 13 (ObjNum 82 snap 8 seq_num 82) dirty exists 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:139: left oid 32 (ObjNum 82 snap 8 seq_num 82) 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:142: seq_num 83 ranges {0=638976,638976=622592,1261568=147456} 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:142: writing smithi20431790-13 from 0 to 638976 tid 1 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:142: writing smithi20431790-13 from 638976 to 1261568 tid 2 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:142: writing smithi20431790-13 from 1261568 to 1409024 tid 3 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:139: done (2 left) 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:140: done (1 left) 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:143: delete oid 17 current snap is 8 2024-09-16T04:08:30.901 INFO:tasks.rados.rados.0.smithi204.stdout:143: done (1 left) 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:144: snap_create 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: finishing write tid 1 to smithi20431790-13 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: finishing write tid 2 to smithi20431790-13 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: finishing write tid 3 to smithi20431790-13 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: finishing write tid 4 to smithi20431790-13 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: finishing write tid 5 to smithi20431790-13 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: oid 13 updating version 0 to 40 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: oid 13 updating version 40 to 41 2024-09-16T04:08:30.902 INFO:tasks.rados.rados.0.smithi204.stdout:142: oid 13 updating version 41 to 42 2024-09-16T04:08:30.903 INFO:tasks.rados.rados.0.smithi204.stdout:142: oid 13 version 42 is already newer than 39 2024-09-16T04:08:30.903 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 13 v 42 (ObjNum 83 snap 8 seq_num 83) dirty exists 2024-09-16T04:08:30.903 INFO:tasks.rados.rados.0.smithi204.stdout:142: left oid 13 (ObjNum 83 snap 8 seq_num 83) 2024-09-16T04:08:30.903 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:30.891+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:30.996 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:30.991+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:31.036 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:31.036 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:31.036 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:31.036 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:31.050 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:08:31.097 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:31.093+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:31.198 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:31.198+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:31.217 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:31.218 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:31.218 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:31.218 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:31.218 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:31.231 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:08:31.299 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:31.298+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:31.360 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:31.360 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.419742117, 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088452600000000006, 2024-09-16T04:08:31.361 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.362 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:31.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7599999999999997e-07 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937675+0000", 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000112378 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.364 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1192e-05 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937716+0000", 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9786e-05 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937875+0000", 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015905699999999999 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937897+0000", 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2442999999999998e-05 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946338+0000", 2024-09-16T04:08:31.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084413119999999994 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946407+0000", 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8516000000000006e-05 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 33/31 ECSubWrite(tid=1, reqid=client.4631.0:5, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.937857+0000", 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.419446943000001, 2024-09-16T04:08:31.367 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0036422109999999998, 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937857+0000", 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937857+0000", 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937858+0000", 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.173e-06 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937892+0000", 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4158000000000001e-05 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937924+0000", 2024-09-16T04:08:31.369 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1344999999999999e-05 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937944+0000", 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0009000000000001e-05 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.938145+0000", 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020131899999999999 2024-09-16T04:08:31.370 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.938168+0000", 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2855000000000001e-05 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941417+0000", 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003249573 2024-09-16T04:08:31.371 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941499+0000", 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1779000000000004e-05 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:31.372 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.418150559000001, 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073144209999999998, 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.373 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939155+0000", 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.823e-06 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.374 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939194+0000", 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9060999999999998e-05 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939224+0000", 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0009e-05 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.375 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939288+0000", 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4290999999999998e-05 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939471+0000", 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018293899999999999 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939493+0000", 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1849999999999999e-05 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.376 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946414+0000", 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069205860000000003 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946468+0000", 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3862e-05 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.377 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 33/31 ECSubWrite(tid=4, reqid=client.4631.0:19, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942918+0000", 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.414385396, 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0033653680000000001, 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942918+0000", 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.378 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942918+0000", 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942920+0000", 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1429999999999999e-06 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943041+0000", 2024-09-16T04:08:31.379 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000121688 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943064+0000", 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3139e-05 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943084+0000", 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0064e-05 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.380 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.381 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943236+0000", 2024-09-16T04:08:31.381 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000151266 2024-09-16T04:08:31.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.381 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943257+0000", 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1029000000000001e-05 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946184+0000", 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0029277159999999999 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946284+0000", 2024-09-16T04:08:31.382 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9322999999999998e-05 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 33/31 ECSubWrite(tid=5, reqid=client.4631.0:20, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945460+0000", 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.411843654, 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003271164, 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.383 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945460+0000", 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945460+0000", 2024-09-16T04:08:31.384 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945462+0000", 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.477e-06 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945499+0000", 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7818000000000003e-05 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.385 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945528+0000", 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8653000000000002e-05 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945558+0000", 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0244e-05 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945763+0000", 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000204806 2024-09-16T04:08:31.386 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945785+0000", 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1664000000000001e-05 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948635+0000", 2024-09-16T04:08:31.387 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002850193 2024-09-16T04:08:31.388 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.388 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.388 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.388 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948731+0000", 2024-09-16T04:08:31.388 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6309000000000002e-05 2024-09-16T04:08:31.388 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=0, reqid=client.4631.0:34, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.40337098, 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010827755999999999, 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.389 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953934+0000", 2024-09-16T04:08:31.390 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3099999999999996e-07 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955299+0000", 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001365401 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955338+0000", 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8804000000000003e-05 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.391 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955361+0000", 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3472000000000002e-05 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000184064 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955568+0000", 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2425e-05 2024-09-16T04:08:31.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964640+0000", 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090716189999999995 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964761+0000", 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012104000000000001 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.393 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=2, reqid=client.4631.0:17, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.400934487000001, 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093557269999999994, 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.394 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956371+0000", 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9069999999999999e-06 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956399+0000", 2024-09-16T04:08:31.395 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7784999999999999e-05 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956441+0000", 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1727999999999998e-05 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.396 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956464+0000", 2024-09-16T04:08:31.397 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2991999999999999e-05 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956620+0000", 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015645500000000001 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956649+0000", 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8438000000000001e-05 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.398 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965629+0000", 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089807140000000008 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965725+0000", 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5707999999999999e-05 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.399 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 34/31 ECSubWrite(tid=2, reqid=client.4631.0:5, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.400715334999999, 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092008920000000004, 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.400 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956590+0000", 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5060000000000001e-06 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.401 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956611+0000", 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1123000000000001e-05 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956633+0000", 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1464999999999999e-05 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.402 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956651+0000", 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8113000000000001e-05 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956835+0000", 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018435000000000001 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.403 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956855+0000", 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9629000000000001e-05 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965720+0000", 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088648259999999993 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965789+0000", 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9880000000000002e-05 2024-09-16T04:08:31.404 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=1, reqid=client.4631.0:35, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.397924784000001, 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006492589, 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.405 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.406 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959380+0000", 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.42e-06 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959416+0000", 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5373000000000002e-05 2024-09-16T04:08:31.407 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.408 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.408 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.408 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959452+0000", 2024-09-16T04:08:31.408 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6328999999999997e-05 2024-09-16T04:08:31.408 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.408 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959471+0000", 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8991000000000002e-05 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959623+0000", 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015206900000000001 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959635+0000", 2024-09-16T04:08:31.409 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1712000000000001e-05 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965813+0000", 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061778650000000003 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965872+0000", 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8829999999999997e-05 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.410 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.411 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.411 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.411 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 34/31 ECSubWrite(tid=8, reqid=client.4631.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:31.411 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:31.411 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.395878785000001, 2024-09-16T04:08:31.412 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048114000000000004, 2024-09-16T04:08:31.412 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.412 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.412 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.412 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.412 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.413 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.413 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:31.413 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.413 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.413 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.414 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.414 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:31.414 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.414 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.415 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.415 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.415 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961426+0000", 2024-09-16T04:08:31.415 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5900000000000005e-07 2024-09-16T04:08:31.415 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.416 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.416 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.416 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961448+0000", 2024-09-16T04:08:31.416 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2376000000000001e-05 2024-09-16T04:08:31.416 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.417 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.417 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.417 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961480+0000", 2024-09-16T04:08:31.417 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1862000000000001e-05 2024-09-16T04:08:31.418 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.418 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.418 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.418 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961504+0000", 2024-09-16T04:08:31.418 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3921e-05 2024-09-16T04:08:31.418 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.419 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.419 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961641+0000", 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013634000000000001 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961659+0000", 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8451e-05 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.420 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966086+0000", 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044267330000000004 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966236+0000", 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000150758 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.421 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=4, reqid=client.4631.0:52, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.967962+0000", 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.389341646, 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0039629310000000003, 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967962+0000", 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.422 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967962+0000", 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967964+0000", 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.742e-06 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968124+0000", 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000160204 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.423 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968161+0000", 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6579999999999999e-05 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968179+0000", 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8539e-05 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.969234+0000", 2024-09-16T04:08:31.424 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001054857 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.969248+0000", 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4129e-05 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.971834+0000", 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002585712 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.425 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.971925+0000", 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.1168000000000005e-05 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=5, reqid=client.4631.0:53, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.968830+0000", 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.388473694, 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031711790000000001, 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.426 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968830+0000", 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968830+0000", 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968832+0000", 2024-09-16T04:08:31.427 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5179999999999999e-06 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968889+0000", 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7612999999999999e-05 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968919+0000", 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9569000000000001e-05 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.428 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968938+0000", 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8808999999999999e-05 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970825+0000", 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00188729 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970848+0000", 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3003e-05 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.971947+0000", 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0010991690000000001 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972001+0000", 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4208e-05 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.430 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds5 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.371125697, 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0064133979999999998, 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.431 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986180+0000", 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.61e-06 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986500+0000", 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00032045199999999999 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.432 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986536+0000", 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5522999999999999e-05 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986565+0000", 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9445999999999999e-05 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986758+0000", 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019237 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.433 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986779+0000", 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1359e-05 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992509+0000", 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0057302610000000004 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992592+0000", 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2377000000000001e-05 2024-09-16T04:08:31.434 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=10, reqid=client.4631.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.989628+0000", 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.367675901, 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0035144740000000001, 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.435 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989628+0000", 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989628+0000", 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989629+0000", 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.497e-06 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.436 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989652+0000", 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2527e-05 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989682+0000", 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9958e-05 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989699+0000", 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7567e-05 2024-09-16T04:08:31.437 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990035+0000", 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033569399999999999 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990054+0000", 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8468999999999999e-05 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993059+0000", 2024-09-16T04:08:31.438 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003005443 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993142+0000", 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3319000000000006e-05 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 34/31 ECSubWrite(tid=15, reqid=client.4631.0:73, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.991113+0000", 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.366191209, 2024-09-16T04:08:31.439 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0032542169999999998, 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991113+0000", 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991113+0000", 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.440 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991113+0000", 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2699999999999999e-07 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991461+0000", 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000347621 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.441 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991485+0000", 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4066999999999998e-05 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991505+0000", 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0169999999999998e-05 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991625+0000", 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120041 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.442 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991642+0000", 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6991999999999999e-05 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.994293+0000", 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002650651 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.994367+0000", 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4147999999999995e-05 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.443 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=8, reqid=client.4631.0:70, at_version=34'3, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.991616+0000", 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.365687464000001, 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040229030000000004, 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.444 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991616+0000", 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991616+0000", 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991618+0000", 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5600000000000001e-06 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.445 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992062+0000", 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00044383600000000002 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992096+0000", 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3824e-05 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992115+0000", 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9156000000000001e-05 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.446 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992338+0000", 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022281300000000001 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992358+0000", 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9939e-05 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995484+0000", 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031261409999999998 2024-09-16T04:08:31.447 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995639+0000", 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015563400000000001 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 44/31 ECSubWrite(tid=48, reqid=client.4631.0:302, at_version=44'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:27.041655+0000", 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.3156489069999999, 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0036997760000000001, 2024-09-16T04:08:31.448 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.041655+0000", 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.041655+0000", 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.449 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.041656+0000", 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.6000000000000003e-07 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.042140+0000", 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00048483400000000001 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.042171+0000", 2024-09-16T04:08:31.450 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0757999999999999e-05 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.042217+0000", 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.6029000000000003e-05 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.042386+0000", 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000168486 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.451 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.042403+0000", 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7048999999999999e-05 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.045287+0000", 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0028840329999999998 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.045355+0000", 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.7927000000000002e-05 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.452 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 44/31 ECSubWrite(tid=49, reqid=client.4631.0:303, at_version=44'9, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:27.049870+0000", 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.3074336669999997, 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.004207265, 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.453 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.049870+0000", 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.049870+0000", 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.049872+0000", 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9089999999999998e-06 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.454 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.050265+0000", 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000392851 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.050304+0000", 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9038000000000001e-05 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.050327+0000", 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2603e-05 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.455 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.051070+0000", 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00074359600000000001 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.051097+0000", 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7126000000000001e-05 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.053997+0000", 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0028998560000000001 2024-09-16T04:08:31.456 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:27.054077+0000", 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0285999999999997e-05 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 0.50452226099999997, 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094335619999999995, 2024-09-16T04:08:31.457 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.458 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3300000000000001e-07 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852840+0000", 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8068e-05 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.459 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852875+0000", 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4016000000000001e-05 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852916+0000", 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1301000000000003e-05 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853436+0000", 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052021800000000003 2024-09-16T04:08:31.460 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853462+0000", 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5602e-05 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862103+0000", 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086416559999999993 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862215+0000", 2024-09-16T04:08:31.461 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011186799999999999 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 0.50400477700000001, 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088015860000000001, 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:31.462 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853300+0000", 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:08:31.463 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853354+0000", 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3897999999999998e-05 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853383+0000", 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9689e-05 2024-09-16T04:08:31.464 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853406+0000", 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2289e-05 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853644+0000", 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023859799999999999 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853670+0000", 2024-09-16T04:08:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5609000000000002e-05 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.861999+0000", 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083290640000000006 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862101+0000", 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000101846 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:31.466 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:31.467 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:31.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:08:31.469 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:31.463+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:31.568 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:31.563+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:31.638 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:31.638 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:31.638 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:31.638 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:31.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:08:31.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:31.695+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:31.771 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:31.767+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:31.822 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:31.823 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:31.823 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:31.823 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:31.823 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:31.836 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:08:31.845 INFO:tasks.rados.rados.0.smithi204.stdout:142: done (1 left) 2024-09-16T04:08:31.845 INFO:tasks.rados.rados.0.smithi204.stdout:144: done (0 left) 2024-09-16T04:08:31.845 INFO:tasks.rados.rados.0.smithi204.stdout:145: snap_create 2024-09-16T04:08:31.846 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.8 to 1 (10000) 2024-09-16T04:08:31.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-16T04:08:31.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-16T04:08:31.871 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:31.869+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:31.972 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:31.967+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:32.004 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 33/31 ECSubWrite(tid=1, reqid=client.4631.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.940003+0000", 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.061446108, 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006682215, 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.005 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940003+0000", 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940003+0000", 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940003+0000", 2024-09-16T04:08:32.006 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.37e-07 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940090+0000", 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6952000000000004e-05 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940119+0000", 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8357999999999999e-05 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.007 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940138+0000", 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9528999999999999e-05 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940270+0000", 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013189699999999999 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940288+0000", 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8382000000000001e-05 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.008 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946583+0000", 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062941400000000002 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946685+0000", 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010221999999999999 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.009 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s5 34/31 ECSubWrite(tid=8, reqid=client.4631.0:61, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.977191+0000", 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.024257447, 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0059094869999999997, 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977191+0000", 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.010 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977191+0000", 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977193+0000", 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.333e-06 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977397+0000", 2024-09-16T04:08:32.011 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000204637 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977429+0000", 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2243999999999998e-05 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977448+0000", 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8766999999999998e-05 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.012 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977645+0000", 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000196546 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977667+0000", 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2101999999999999e-05 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983022+0000", 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053552510000000001 2024-09-16T04:08:32.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983101+0000", 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8607000000000001e-05 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s5 34/31 ECSubWrite(tid=9, reqid=client.4631.0:62, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.977941+0000", 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.023507911999999, 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090075710000000007, 2024-09-16T04:08:32.014 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977941+0000", 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977941+0000", 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.015 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977942+0000", 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.437e-06 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977981+0000", 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8583e-05 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978003+0000", 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1725999999999998e-05 2024-09-16T04:08:32.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978020+0000", 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7759000000000001e-05 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979397+0000", 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0013765870000000001 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979419+0000", 2024-09-16T04:08:32.017 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2385e-05 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986850+0000", 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.007430776 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986948+0000", 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.8318000000000003e-05 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.018 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 34/31 ECSubWrite(tid=16, reqid=client.4631.0:56, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.981179+0000", 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.020269851, 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058465510000000002, 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981179+0000", 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.019 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981179+0000", 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981181+0000", 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.917e-06 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981222+0000", 2024-09-16T04:08:32.020 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.0890999999999999e-05 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981253+0000", 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1572000000000002e-05 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981277+0000", 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3458000000000001e-05 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.021 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981491+0000", 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021476500000000001 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981514+0000", 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2768999999999998e-05 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986957+0000", 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0054427340000000003 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.022 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987025+0000", 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8444999999999999e-05 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s5 34/31 ECSubWrite(tid=17, reqid=client.4631.0:46, at_version=34'7, trim_to=0'0, roll_forward_to=33'4))", 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.982673+0000", 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.018776214000001, 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070656770000000002, 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.023 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982673+0000", 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982673+0000", 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.024 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982675+0000", 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0030000000000001e-06 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982853+0000", 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000178927 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982884+0000", 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0470000000000001e-05 2024-09-16T04:08:32.025 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982905+0000", 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1365e-05 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983130+0000", 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000224553 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.026 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983152+0000", 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2232999999999999e-05 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989670+0000", 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065179720000000003 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989738+0000", 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8153999999999998e-05 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.027 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.5s1 34/31 ECSubWrite(tid=6, reqid=client.4631.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.983583+0000", 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.017865244999999, 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061999519999999999, 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.028 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983583+0000", 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983583+0000", 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983585+0000", 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.482e-06 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.029 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983610+0000", 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4836000000000001e-05 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983636+0000", 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6449e-05 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983654+0000", 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7941999999999999e-05 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983830+0000", 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017625299999999999 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983852+0000", 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1075999999999999e-05 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989711+0000", 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005859576 2024-09-16T04:08:32.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989783+0000", 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.2337999999999998e-05 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds6 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.985772+0000", 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.015676827, 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069610690000000003, 2024-09-16T04:08:32.032 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985772+0000", 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985772+0000", 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.033 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985773+0000", 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.1099999999999995e-07 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987452+0000", 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0016791270000000001 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987486+0000", 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4261000000000003e-05 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987515+0000", 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9227e-05 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987634+0000", 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011872299999999999 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987650+0000", 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5809000000000001e-05 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992670+0000", 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050198439999999999 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992733+0000", 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.3466999999999994e-05 2024-09-16T04:08:32.036 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:76 3.1s0 3:8cd578d6:::smithi20431790-26:head [append 0~425984,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.010726132, 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016989746999999999, 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.037 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 76 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.038 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990725+0000", 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7659999999999999e-06 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991908+0000", 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011824369999999999 2024-09-16T04:08:32.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991959+0000", 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1104999999999999e-05 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991974+0000", 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.507e-05 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992175+0000", 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000200748 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992429+0000", 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025421900000000003 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.994438+0000", 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0020088559999999998 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.000632+0000", 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061938200000000001 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007596+0000", 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069640379999999997 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007712+0000", 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000116688 2024-09-16T04:08:32.042 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:77 3.1s0 3:8cd578d6:::smithi20431790-26:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.009433785000001, 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016129303000000001, 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.043 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 77 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992016+0000", 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.142e-06 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992029+0000", 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2622e-05 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992042+0000", 2024-09-16T04:08:32.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3453e-05 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992050+0000", 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0830000000000004e-06 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996215+0000", 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0041647710000000003 2024-09-16T04:08:32.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996322+0000", 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000106525 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996924+0000", 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00060262499999999997 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.001154+0000", 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0042302959999999997 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007954+0000", 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006799462 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008144+0000", 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019032399999999999 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.049 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:78 3.1s0 3:8cd578d6:::smithi20431790-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.0093011, 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019834738000000001, 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.050 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 78 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6300000000000004e-07 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992154+0000", 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5350000000000004e-06 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992164+0000", 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0467e-05 2024-09-16T04:08:32.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992176+0000", 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1438e-05 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.997489+0000", 2024-09-16T04:08:32.053 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053126850000000002 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.997713+0000", 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000224797 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008726+0000", 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011012533999999999 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008813+0000", 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6673000000000002e-05 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.011982+0000", 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031697460000000002 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs6 34/31 ECSubWrite(tid=8, reqid=client.4631.0:70, at_version=34'3, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.993119+0000", 2024-09-16T04:08:32.055 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.008329635999999, 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065637059999999999, 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993119+0000", 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.056 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993119+0000", 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993120+0000", 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7199999999999997e-07 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993311+0000", 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019095900000000001 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993330+0000", 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8961e-05 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993342+0000", 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1702000000000001e-05 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993484+0000", 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014220500000000001 2024-09-16T04:08:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.993595+0000", 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000110876 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.999619+0000", 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0060241720000000004 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.999683+0000", 2024-09-16T04:08:32.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.3859e-05 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:108 3.1s0 3:8c94f6f5:::smithi20431790-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:17.027755+0000", 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.973694141999999, 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073325919999999998, 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.060 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 108 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027755+0000", 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027755+0000", 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027755+0000", 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.6400000000000001e-07 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027760+0000", 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.34e-06 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027769+0000", 2024-09-16T04:08:32.062 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7450000000000007e-06 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027777+0000", 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9729999999999997e-06 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.030590+0000", 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0028121370000000001 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.063 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.030656+0000", 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.6679000000000003e-05 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.033553+0000", 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0028969220000000001 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.033631+0000", 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.7590999999999996e-05 2024-09-16T04:08:32.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.035087+0000", 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0014564409999999999 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s6 39/31 ECSubWrite(tid=20, reqid=client.4631.0:188, at_version=39'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:21.999106+0000", 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.002342466, 2024-09-16T04:08:32.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062601139999999998, 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999106+0000", 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.066 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999106+0000", 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999107+0000", 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4600000000000004e-07 2024-09-16T04:08:32.067 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999538+0000", 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00043114299999999999 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999565+0000", 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6965e-05 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.068 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999587+0000", 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2149000000000001e-05 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999769+0000", 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000181996 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999796+0000", 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7072000000000001e-05 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.005279+0000", 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0054829010000000001 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.005366+0000", 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7242000000000003e-05 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s6 48/31 ECSubWrite(tid=60, reqid=osd.12.0:59, at_version=0'0, trim_to=0'0, roll_forward_to=48'21))", 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.850057+0000", 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.151391909, 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.007517864, 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.071 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850057+0000", 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850057+0000", 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850059+0000", 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8929999999999999e-06 2024-09-16T04:08:32.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850085+0000", 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5999e-05 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850165+0000", 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0517000000000002e-05 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850188+0000", 2024-09-16T04:08:32.073 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3132000000000001e-05 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850432+0000", 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024367099999999999 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850455+0000", 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3376000000000001e-05 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.857499+0000", 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070434759999999999 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.857575+0000", 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5799999999999999e-05 2024-09-16T04:08:32.075 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.0s6 48/31 ECSubWrite(tid=61, reqid=osd.12.0:58, at_version=0'0, trim_to=0'0, roll_forward_to=48'23))", 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.850413+0000", 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.151035936, 2024-09-16T04:08:32.076 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071059670000000004, 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850413+0000", 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.077 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850413+0000", 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850414+0000", 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3689999999999999e-06 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.078 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850437+0000", 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2566999999999999e-05 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850455+0000", 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8669e-05 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850473+0000", 2024-09-16T04:08:32.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7269e-05 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850778+0000", 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00030540199999999997 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.850802+0000", 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3986e-05 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.857413+0000", 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006610795 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.857519+0000", 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010590999999999999 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.081 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 48/31 ECSubWrite(tid=144, reqid=osd.10.0:144, at_version=48'64, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852572+0000", 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.1488768039999999, 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0081378679999999995, 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.082 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852572+0000", 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852572+0000", 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852573+0000", 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.5300000000000004e-07 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.083 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852652+0000", 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9673999999999996e-05 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852690+0000", 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7412e-05 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852714+0000", 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3995999999999999e-05 2024-09-16T04:08:32.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.085 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.085 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.085 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853013+0000", 2024-09-16T04:08:32.086 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00029908799999999998 2024-09-16T04:08:32.086 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.086 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.086 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853041+0000", 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7846000000000001e-05 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860590+0000", 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0075489270000000004 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860710+0000", 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120272 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.087 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s5 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.1486665119999999, 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071947340000000004, 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852783+0000", 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6599999999999994e-07 2024-09-16T04:08:32.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852824+0000", 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1146000000000002e-05 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852853+0000", 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8564999999999998e-05 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.090 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852872+0000", 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8626000000000001e-05 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853166+0000", 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000294503 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853190+0000", 2024-09-16T04:08:32.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3849000000000002e-05 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.859858+0000", 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0066679900000000004 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.859977+0000", 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000119089 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.092 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs6 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.853100+0000", 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.1483487880000001, 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078536160000000008, 2024-09-16T04:08:32.093 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853100+0000", 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853100+0000", 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853101+0000", 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6000000000000002e-07 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853152+0000", 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1388999999999999e-05 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853175+0000", 2024-09-16T04:08:32.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2379e-05 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853195+0000", 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0622999999999999e-05 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853999+0000", 2024-09-16T04:08:32.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00080373900000000004 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854022+0000", 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3030000000000001e-05 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860876+0000", 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068543689999999999 2024-09-16T04:08:32.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860954+0000", 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.7226999999999998e-05 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.855607+0000", 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.1458418049999999, 2024-09-16T04:08:32.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084318569999999992, 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855607+0000", 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855607+0000", 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855609+0000", 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2029999999999999e-06 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855664+0000", 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4712000000000001e-05 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855698+0000", 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4499000000000003e-05 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855721+0000", 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2265000000000001e-05 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855878+0000", 2024-09-16T04:08:32.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015689799999999999 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855903+0000", 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5585e-05 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.863941+0000", 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0080380320000000005 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864039+0000", 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7663000000000003e-05 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s5 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.860535+0000", 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.140914116, 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058391199999999997, 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.103 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860535+0000", 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860535+0000", 2024-09-16T04:08:32.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860537+0000", 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1160000000000002e-06 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860592+0000", 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5714999999999998e-05 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860625+0000", 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2398999999999999e-05 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860648+0000", 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2759e-05 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860802+0000", 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015408699999999999 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860826+0000", 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4749999999999999e-05 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.866294+0000", 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0054670669999999999 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.866374+0000", 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0227000000000003e-05 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.108 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:32.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:08:32.110 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:32.107+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:32.210 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:32.207+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:32.288 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:32.288 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:32.288 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:32.288 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:32.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:08:32.311 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:32.307+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:32.412 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:32.410+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:32.420 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:32.420 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:32.420 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:32.420 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:32.421 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:32.434 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:08:32.513 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:32.510+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:32.556 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:32.556 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:32.556 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:1 3.4s0 3:23761325:::smithi20431790-1:head [append 0~32768,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932663+0000", 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.620439499, 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.02373635, 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.557 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 1 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932663+0000", 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932663+0000", 2024-09-16T04:08:32.558 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932666+0000", 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7250000000000002e-06 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932808+0000", 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000142378 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.559 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932830+0000", 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2036e-05 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932846+0000", 2024-09-16T04:08:32.560 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5410999999999999e-05 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932978+0000", 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013213 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933221+0000", 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000243615 2024-09-16T04:08:32.561 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.938491+0000", 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0052696100000000001 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003604777 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956246+0000", 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.014150190999999999 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956399+0000", 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015347700000000001 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.563 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:2 3.4s0 3:23761325:::smithi20431790-1:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.620225842, 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.025102767000000002, 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.564 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 2 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932878+0000", 2024-09-16T04:08:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.477e-06 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932887+0000", 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.0529999999999996e-06 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932905+0000", 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7428e-05 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932920+0000", 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5568000000000001e-05 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939855+0000", 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069352210000000001 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.568 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940080+0000", 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022506800000000001 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011671030000000001 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949403+0000", 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0081551360000000003 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957764+0000", 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083610560000000004 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.570 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957979+0000", 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021565700000000001 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:3 3.4s0 3:23761325:::smithi20431790-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.571 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.620163183000001, 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.046611916000000003, 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 3 2024-09-16T04:08:32.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.573 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932940+0000", 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1799999999999999e-06 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932969+0000", 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8867e-05 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.574 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932988+0000", 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9173000000000001e-05 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933004+0000", 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5821999999999999e-05 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941757+0000", 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087529989999999992 2024-09-16T04:08:32.575 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941968+0000", 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021104500000000001 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958099+0000", 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016130480999999999 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958362+0000", 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026272900000000001 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979551+0000", 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021189619999999999 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:13 3.bs0 3:ddc630b6:::smithi20431790-5:head [append 0~81920,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.933640+0000", 2024-09-16T04:08:32.577 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.619462893, 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022034354999999999, 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 13 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933640+0000", 2024-09-16T04:08:32.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933640+0000", 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933642+0000", 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3e-06 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.579 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933867+0000", 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000225391 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933902+0000", 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4989e-05 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933920+0000", 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7575999999999999e-05 2024-09-16T04:08:32.580 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934047+0000", 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000126759 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934273+0000", 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000226634 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940231+0000", 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0059576619999999999 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955383+0000", 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01515176 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955515+0000", 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013239 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955674+0000", 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000158894 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:14 3.bs0 3:ddc630b6:::smithi20431790-5:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.619147836, 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.029025773000000001, 2024-09-16T04:08:32.583 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 14 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:32.584 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933956+0000", 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.455e-06 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933963+0000", 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1450000000000002e-06 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933980+0000", 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6909999999999999e-05 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933994+0000", 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4236999999999999e-05 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.944227+0000", 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010232893 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.947374+0000", 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031466839999999999 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952631+0000", 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005256635 2024-09-16T04:08:32.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956032+0000", 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0034013939999999999 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.962586+0000", 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006554458 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.588 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.962980+0000", 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00039396199999999998 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:15 3.bs0 3:ddc630b6:::smithi20431790-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.619087049999999, 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044909575, 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.589 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 15 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.590 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934017+0000", 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.302e-06 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934023+0000", 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2140000000000001e-06 2024-09-16T04:08:32.591 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934039+0000", 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5690999999999999e-05 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934052+0000", 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3728e-05 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.592 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955822+0000", 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021769189000000001 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956014+0000", 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019218999999999999 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963151+0000", 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00713688 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.593 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963673+0000", 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052261899999999999 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978925+0000", 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015251762 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.594 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:22 3.4s0 3:20db2d5a:::smithi20431790-8:head [append 0~131072,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.940777+0000", 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.612324992, 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018894351, 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 22 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.595 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940777+0000", 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940777+0000", 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940780+0000", 2024-09-16T04:08:32.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7269999999999999e-06 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941063+0000", 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028231099999999999 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941088+0000", 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5471999999999999e-05 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941108+0000", 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0231999999999999e-05 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942279+0000", 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00117044 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942611+0000", 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033249499999999998 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.944340+0000", 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0017287629999999999 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.954144+0000", 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098043350000000008 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959516+0000", 2024-09-16T04:08:32.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053716440000000001 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959672+0000", 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015593200000000001 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:23 3.4s0 3:20db2d5a:::smithi20431790-8:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941142+0000", 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.611960467999999, 2024-09-16T04:08:32.600 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019719719, 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 23 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941142+0000", 2024-09-16T04:08:32.601 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941142+0000", 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941144+0000", 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0059999999999999e-06 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941160+0000", 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6158999999999999e-05 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941179+0000", 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8425999999999999e-05 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941194+0000", 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5449000000000001e-05 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945656+0000", 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044622139999999999 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945883+0000", 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022663100000000001 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.947105+0000", 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0012216460000000001 2024-09-16T04:08:32.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.954306+0000", 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0072012250000000003 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.960674+0000", 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0063683530000000002 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.960862+0000", 2024-09-16T04:08:32.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018761 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:24 3.4s0 3:20db2d5a:::smithi20431790-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.611862207, 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039181856000000001, 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.606 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 24 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941242+0000", 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4670000000000001e-06 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.608 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2519999999999996e-06 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941266+0000", 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8502999999999999e-05 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941281+0000", 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4642e-05 2024-09-16T04:08:32.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949167+0000", 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078853970000000006 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949385+0000", 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000218929 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961609+0000", 2024-09-16T04:08:32.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012224016000000001 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961801+0000", 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019127200000000001 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980422+0000", 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018621378000000001 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:28 3.4s0 3:29c49be6:::smithi20431790-10:head [append 0~163840,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.607618369000001, 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039204422000000003, 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 28 2024-09-16T04:08:32.612 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945486+0000", 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945810+0000", 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000323713 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945834+0000", 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3858000000000001e-05 2024-09-16T04:08:32.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945851+0000", 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7099999999999999e-05 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.615 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965628+0000", 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019777501999999999 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965920+0000", 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00029198400000000002 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967512+0000", 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015920190000000001 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.617 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984489+0000", 2024-09-16T04:08:32.617 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016976872 2024-09-16T04:08:32.617 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.618 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.618 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.618 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984601+0000", 2024-09-16T04:08:32.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000111969 2024-09-16T04:08:32.619 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.619 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984689+0000", 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7554999999999998e-05 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.620 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:29 3.4s0 3:29c49be6:::smithi20431790-10:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.607223766000001, 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041668905999999999, 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 29 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.621 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:32.622 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945880+0000", 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7060000000000001e-06 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.623 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945888+0000", 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8630000000000008e-06 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945906+0000", 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8165e-05 2024-09-16T04:08:32.625 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.626 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.626 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.626 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945921+0000", 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4233000000000001e-05 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.969983+0000", 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.024062503999999998 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.627 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970182+0000", 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000198784 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.975849+0000", 2024-09-16T04:08:32.628 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0056673210000000003 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984708+0000", 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088582690000000002 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.629 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987208+0000", 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0025007359999999999 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987548+0000", 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033932500000000002 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.630 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:30 3.4s0 3:29c49be6:::smithi20431790-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.607136070999999, 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044609479, 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.631 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 30 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.632 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945968+0000", 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5629999999999999e-06 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945975+0000", 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.063e-06 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945994+0000", 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9415999999999998e-05 2024-09-16T04:08:32.633 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946009+0000", 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4969e-05 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978603+0000", 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.032593521 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978799+0000", 2024-09-16T04:08:32.634 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000196336 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987651+0000", 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088521820000000001 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.635 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987845+0000", 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019347900000000001 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990576+0000", 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027309499999999998 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.636 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.637 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.637 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.637 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:40 3.bs0 3:dfb3e098:::smithi20431790-14:head [append 0~229376,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.637 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.952713+0000", 2024-09-16T04:08:32.637 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.600389913000001, 2024-09-16T04:08:32.637 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022448215000000001, 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 40 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.638 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952713+0000", 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952713+0000", 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952721+0000", 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.354e-06 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.639 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952886+0000", 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000164876 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952914+0000", 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8016000000000001e-05 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952932+0000", 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8329999999999999e-05 2024-09-16T04:08:32.640 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956125+0000", 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031927489999999999 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956389+0000", 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026436100000000001 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.641 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958429+0000", 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0020400119999999999 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964627+0000", 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061974220000000002 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.642 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.974978+0000", 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010351552 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.975161+0000", 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018254299999999999 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.643 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:41 3.bs0 3:dfb3e098:::smithi20431790-14:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.952962+0000", 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.600140358000001, 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.023896552000000001, 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 41 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.644 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952962+0000", 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952962+0000", 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952964+0000", 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8029999999999999e-06 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952973+0000", 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6160000000000002e-06 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952993+0000", 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0055999999999999e-05 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953019+0000", 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6647000000000001e-05 2024-09-16T04:08:32.646 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959843+0000", 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068240439999999996 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.647 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.960062+0000", 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021857800000000001 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961175+0000", 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011126860000000001 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964874+0000", 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003699871 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.648 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.976657+0000", 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011782907 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.976859+0000", 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000201344 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.649 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:42 3.bs0 3:dfb3e098:::smithi20431790-14:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.600062080000001, 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030384648, 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 42 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.650 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953042+0000", 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2750000000000001e-06 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.651 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953049+0000", 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3819999999999998e-06 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953071+0000", 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.213e-05 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953086+0000", 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4691e-05 2024-09-16T04:08:32.652 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966890+0000", 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013804448 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968398+0000", 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015072379999999999 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977027+0000", 2024-09-16T04:08:32.653 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086299559999999994 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977565+0000", 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00053773700000000005 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983425+0000", 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058597909999999996 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.654 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:46 3.4s0 3:285c2ad8:::smithi20431790-16:head [append 0~262144,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.595750777999999, 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.033667818000000002, 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 46 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.655 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957361+0000", 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8279999999999992e-06 2024-09-16T04:08:32.656 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957823+0000", 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000462912 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957847+0000", 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3329999999999999e-05 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:08:32.657 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7459999999999999e-05 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980701+0000", 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022836372000000001 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980884+0000", 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018340000000000001 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.658 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982553+0000", 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0016689350000000001 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987566+0000", 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050129570000000002 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990888+0000", 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0033219679999999998 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.659 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991019+0000", 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013165599999999999 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:47 3.4s0 3:285c2ad8:::smithi20431790-16:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.595209279000001, 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.037486141000000001, 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.660 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 47 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:32.661 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957895+0000", 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6950000000000001e-06 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957903+0000", 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8679999999999999e-06 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.662 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957923+0000", 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0001e-05 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957942+0000", 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9368000000000002e-05 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985229+0000", 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027287148000000001 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.663 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985602+0000", 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037240199999999998 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986575+0000", 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00097305500000000001 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989838+0000", 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0032630300000000001 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.664 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995213+0000", 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053754359999999999 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995379+0000", 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000166138 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.665 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:48 3.4s0 3:285c2ad8:::smithi20431790-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.595140584999999, 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041004387000000003, 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 48 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.666 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957963+0000", 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.437e-06 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.667 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957969+0000", 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8370000000000002e-06 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957990+0000", 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0883999999999999e-05 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.668 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958003+0000", 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3377000000000001e-05 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.988975+0000", 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030971772000000002 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989143+0000", 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016802000000000001 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.669 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996033+0000", 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068901420000000001 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996181+0000", 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014787700000000001 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.998966+0000", 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027850409999999998 2024-09-16T04:08:32.670 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:56 3.bs0 3:d6a8a443:::smithi20431790-19:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.970652+0000", 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.582450307, 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021015676, 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.671 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 56 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970652+0000", 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970652+0000", 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.672 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970654+0000", 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7799999999999999e-06 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970665+0000", 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0961999999999999e-05 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.971043+0000", 2024-09-16T04:08:32.673 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000378119 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972008+0000", 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00096480999999999997 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980279+0000", 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0082709789999999995 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.674 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980461+0000", 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018214199999999999 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981135+0000", 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00067413599999999998 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983452+0000", 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002316458 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.675 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991507+0000", 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0080552409999999994 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991668+0000", 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000161049 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:57 3.bs0 3:d6a8a443:::smithi20431790-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:32.676 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.581040319, 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027398674000000001, 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 57 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:32.677 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972064+0000", 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6199999999999999e-06 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.678 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972089+0000", 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5650999999999999e-05 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972112+0000", 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2408999999999998e-05 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972129+0000", 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7263999999999999e-05 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.679 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982377+0000", 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010247460999999999 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982554+0000", 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000177071 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995331+0000", 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012777227 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.680 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995447+0000", 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011627400000000001 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.999461+0000", 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040136970000000001 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:32.681 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:32.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:32.683 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:32.681+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:32.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:08:32.784 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:32.781+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:32.812 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:32.812 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:32.812 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:32.812 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:32.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:08:32.835 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:32.835 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-16T04:08:32.849 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.9 to 1 (10000) 2024-09-16T04:08:32.853 INFO:tasks.rados.rados.0.smithi204.stdout:145: done (0 left) 2024-09-16T04:08:32.853 INFO:tasks.rados.rados.0.smithi204.stdout:146: snap_create 2024-09-16T04:08:32.856 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:32.857 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:32.875 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:32.875 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:32.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-16T04:08:32.896 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:32.896 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:32.897 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:32.894+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:32.913 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:32.913 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:32.951 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:32.951 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:32.951 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:32.951 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:32.952 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:32.952 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:32.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:32.966 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:08:32.986 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:32.983+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:32.986 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:33.024 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:33.024 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:33.045 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:33.046 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:33.068 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:33.087 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:33.083+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:33.091 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:33.091 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941612+0000", 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.144773724, 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071844949999999999, 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941612+0000", 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941612+0000", 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941613+0000", 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3e-07 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941792+0000", 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017855400000000001 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941870+0000", 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8842000000000002e-05 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941894+0000", 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3252e-05 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942666+0000", 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00077190099999999997 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942698+0000", 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2625e-05 2024-09-16T04:08:33.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948704+0000", 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0060053759999999998 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948797+0000", 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3214999999999994e-05 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:1, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941639+0000", 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.144747039999999, 2024-09-16T04:08:33.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070030550000000002, 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941639+0000", 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941639+0000", 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941640+0000", 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.271e-06 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941719+0000", 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8349999999999994e-05 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941762+0000", 2024-09-16T04:08:33.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.3089e-05 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941841+0000", 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9293000000000001e-05 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942163+0000", 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00032229399999999999 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942185+0000", 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2044000000000001e-05 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948587+0000", 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0064015629999999999 2024-09-16T04:08:33.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948642+0000", 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5151000000000001e-05 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 33/31 ECSubWrite(tid=1, reqid=client.4631.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941899+0000", 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.144487246000001, 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0067091169999999997, 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941899+0000", 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941899+0000", 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941900+0000", 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.02e-06 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942012+0000", 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000112711 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942035+0000", 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2633000000000002e-05 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942051+0000", 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6228000000000001e-05 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943373+0000", 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001321448 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943392+0000", 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9164000000000002e-05 2024-09-16T04:08:33.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948539+0000", 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0051471709999999999 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948608+0000", 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8742e-05 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.107 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942033+0000", 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.144353423999998, 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0077733439999999997, 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942033+0000", 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942033+0000", 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942035+0000", 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9470000000000002e-06 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942072+0000", 2024-09-16T04:08:33.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7144999999999998e-05 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942099+0000", 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6857999999999999e-05 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942119+0000", 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0503e-05 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.110 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.944999+0000", 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002879759 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945033+0000", 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4575e-05 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949625+0000", 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0045913600000000001 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949806+0000", 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018119699999999999 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.144290219999998, 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013450198999999999, 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.112 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942097+0000", 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.2600000000000001e-07 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942125+0000", 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8059e-05 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942143+0000", 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8116000000000001e-05 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.114 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942165+0000", 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1959000000000001e-05 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943008+0000", 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00084321400000000001 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943028+0000", 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0132999999999998e-05 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955472+0000", 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012443511000000001 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4281000000000003e-05 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.116 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=3, reqid=client.4631.0:22, at_version=33'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.139781588000002, 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01145176, 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946606+0000", 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5939999999999999e-06 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946710+0000", 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010391399999999999 2024-09-16T04:08:33.118 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948852+0000", 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0021415980000000002 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948878+0000", 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.597e-05 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948998+0000", 2024-09-16T04:08:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120791 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949037+0000", 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8680000000000002e-05 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957977+0000", 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089400739999999992 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958056+0000", 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9139000000000002e-05 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=4, reqid=client.4631.0:23, at_version=33'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.1374216, 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0091600550000000003, 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.121 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948966+0000", 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.297e-06 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949000+0000", 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4164e-05 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949155+0000", 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015466000000000001 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.123 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949174+0000", 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9658999999999999e-05 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950232+0000", 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0010573970000000001 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950253+0000", 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1172999999999999e-05 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958067+0000", 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078142119999999992 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958124+0000", 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7493e-05 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 34/31 ECSubWrite(tid=0, reqid=client.4631.0:31, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.125 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.950569+0000", 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.135817286999998, 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073218780000000004, 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950569+0000", 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.126 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950569+0000", 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950570+0000", 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.331e-06 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951371+0000", 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00080050200000000003 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.127 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951428+0000", 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7703e-05 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951449+0000", 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1033e-05 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951579+0000", 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012978999999999999 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.128 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951598+0000", 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9369999999999999e-05 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957819+0000", 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062202129999999996 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957891+0000", 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1935999999999997e-05 2024-09-16T04:08:33.129 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 34/31 ECSubWrite(tid=1, reqid=client.4631.0:32, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.952378+0000", 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.134008054999999, 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0055622370000000003, 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.130 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952378+0000", 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952378+0000", 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952380+0000", 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.649e-06 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.131 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952433+0000", 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3316999999999998e-05 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952462+0000", 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9235e-05 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952482+0000", 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9570999999999999e-05 2024-09-16T04:08:33.132 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952743+0000", 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000261461 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952762+0000", 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8972999999999999e-05 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957897+0000", 2024-09-16T04:08:33.133 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0051353199999999996 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957940+0000", 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2710999999999998e-05 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 34/31 ECSubWrite(tid=21, reqid=client.4631.0:47, at_version=0'0, trim_to=0'0, roll_forward_to=34'8))", 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.090202085000001, 2024-09-16T04:08:33.134 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0066470310000000003, 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:08:33.135 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996185+0000", 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1930000000000001e-06 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996254+0000", 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9326999999999995e-05 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.136 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996301+0000", 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.6721999999999998e-05 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996318+0000", 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6534000000000001e-05 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996442+0000", 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012403300000000001 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.137 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996459+0000", 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6869999999999999e-05 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.002780+0000", 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0063212549999999996 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.002831+0000", 2024-09-16T04:08:33.138 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1097000000000002e-05 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:104 3.6s0 3:6983244e:::smithi20431790-35:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:17.024906+0000", 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.061480195000001, 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0066406859999999998, 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:33.139 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 104 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024906+0000", 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024906+0000", 2024-09-16T04:08:33.140 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024907+0000", 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1119999999999999e-06 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024913+0000", 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4579999999999998e-06 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.141 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024941+0000", 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7529e-05 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024951+0000", 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7729999999999994e-06 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027285+0000", 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002334282 2024-09-16T04:08:33.142 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027356+0000", 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1514999999999995e-05 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.027817+0000", 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00046078699999999999 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028536+0000", 2024-09-16T04:08:33.143 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00071825199999999995 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031428+0000", 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0028925079999999998 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031547+0000", 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011847 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.144 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:105 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.061419488999999, 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092492909999999998, 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:33.145 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 105 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.146 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3600000000000003e-07 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024972+0000", 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.7140000000000001e-06 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024982+0000", 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9620000000000005e-06 2024-09-16T04:08:33.147 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024990+0000", 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5680000000000002e-06 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028098+0000", 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031086120000000002 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028201+0000", 2024-09-16T04:08:33.148 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010293099999999999 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031909+0000", 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003707587 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031957+0000", 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8812e-05 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.149 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.034216+0000", 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0022583690000000001 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:117 3.7s0 3:e9187311:::smithi20431790-39:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:17.039054+0000", 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 16.047331904, 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065386300000000001, 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:33.150 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 117 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.039054+0000", 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.039054+0000", 2024-09-16T04:08:33.151 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.039055+0000", 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9699999999999995e-07 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.039059+0000", 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9299999999999996e-06 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.039067+0000", 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2220000000000002e-06 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.039079+0000", 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1766999999999999e-05 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.042064+0000", 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002985045 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.042171+0000", 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000107642 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.043961+0000", 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001789335 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.044070+0000", 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010962 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.045593+0000", 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015223719999999999 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 39/31 ECSubWrite(tid=20, reqid=client.4631.0:188, at_version=39'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.086660414000001, 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006975902, 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.155 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.156 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2999999999999999e-07 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000284+0000", 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00055737799999999998 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000312+0000", 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8495000000000001e-05 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000334+0000", 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1472e-05 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000511+0000", 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017761200000000001 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000536+0000", 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4981999999999999e-05 2024-09-16T04:08:33.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.006615+0000", 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0060784639999999996 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.006702+0000", 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6669000000000007e-05 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 48/31 ECSubWrite(tid=144, reqid=osd.10.0:144, at_version=48'64, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.2313932200000002, 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0074089819999999997, 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.160 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.3e-07 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855048+0000", 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4134e-05 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855079+0000", 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1656000000000003e-05 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855103+0000", 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3431999999999999e-05 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855473+0000", 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037027300000000001 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855498+0000", 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4649000000000001e-05 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862292+0000", 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0067949220000000001 2024-09-16T04:08:33.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862402+0000", 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000109286 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.855160+0000", 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.2312262559999998, 2024-09-16T04:08:33.164 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0072702000000000001, 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855160+0000", 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.165 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855160+0000", 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855161+0000", 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0100000000000001e-06 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855206+0000", 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.5050999999999999e-05 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855228+0000", 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.211e-05 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855245+0000", 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7295999999999998e-05 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855456+0000", 2024-09-16T04:08:33.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021067199999999999 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855483+0000", 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6971999999999999e-05 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862349+0000", 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068661390000000003 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862430+0000", 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0950000000000003e-05 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.856635+0000", 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.2297505649999998, 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083497799999999994, 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.169 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856635+0000", 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856635+0000", 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.170 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856637+0000", 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.477e-06 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856685+0000", 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.7941000000000001e-05 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856704+0000", 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8929000000000001e-05 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856717+0000", 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3210000000000001e-05 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856900+0000", 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000182523 2024-09-16T04:08:33.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856926+0000", 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6639e-05 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864905+0000", 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0079792370000000001 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864985+0000", 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9824e-05 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.858594+0000", 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.2277920180000002, 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0063746499999999999, 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.174 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858594+0000", 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858594+0000", 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.175 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858596+0000", 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8560000000000001e-06 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858647+0000", 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1075000000000001e-05 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858680+0000", 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3071999999999998e-05 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858703+0000", 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2765999999999999e-05 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858886+0000", 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000183153 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.858911+0000", 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5318999999999999e-05 2024-09-16T04:08:33.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864897+0000", 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0059858150000000002 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864969+0000", 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1594000000000006e-05 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.5s2 48/31 ECSubWrite(tid=61, reqid=client.4631.0:380, at_version=48'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.870270+0000", 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.2161160510000002, 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058731929999999996, 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870270+0000", 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870270+0000", 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870271+0000", 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.6300000000000004e-07 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870321+0000", 2024-09-16T04:08:33.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.0055000000000001e-05 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870353+0000", 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2385999999999998e-05 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870377+0000", 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3731999999999999e-05 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870622+0000", 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024469100000000001 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.870647+0000", 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5902e-05 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.876016+0000", 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053689089999999998 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.876143+0000", 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012675499999999999 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 48/31 ECSubWrite(tid=228, reqid=osd.11.0:224, at_version=0'0, trim_to=0'0, roll_forward_to=48'15))", 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.872755+0000", 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.21363121, 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0055058800000000003, 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:33.183 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.872755+0000", 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.872755+0000", 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.184 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.872757+0000", 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9829999999999999e-06 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.872786+0000", 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9132000000000002e-05 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.872828+0000", 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2542e-05 2024-09-16T04:08:33.185 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.872852+0000", 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3439e-05 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.873081+0000", 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022898800000000001 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.873108+0000", 2024-09-16T04:08:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7039e-05 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.878143+0000", 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050353280000000004 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.878261+0000", 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000117429 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:33.187 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:33.188 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:33.189 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:33.189 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:33.190 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:33.190 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:33.190 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:08:33.191 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:33.191 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:33.191 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:33.191 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:33.192 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:33.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:33.193 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:33.185+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:33.193 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:33.193 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:33.290 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:33.290+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:33.321 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:33.321 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:33.335 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:08:33.391 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:33.387+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:33.454 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:33.454 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:33.468 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:08:33.491 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:33.490+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:33.592 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:33.590+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:33.632 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:33.632 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:33.646 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:08:33.693 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:33.691+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:33.763 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:33.763 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:33.777 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:08:33.794 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:33.791+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:33.856 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.10 to 1 (10000) 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:146: done (0 left) 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:147: copy_from oid 19 from oid 28 current snap is 11 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:148: rollback oid 42 current snap is 11 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 42 to 8 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:149: read oid 41 snap -1 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:149: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:150: read oid 47 snap 10 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:150: expect (ObjNum 61 snap 4 seq_num 61) 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 2 current snap is 11 2024-09-16T04:08:33.858 INFO:tasks.rados.rados.0.smithi204.stdout:151: seq_num 85 ranges {1196032=671744,1867776=770048} 2024-09-16T04:08:33.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-16T04:08:33.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:33.891+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:33.894 INFO:tasks.rados.rados.0.smithi204.stdout:151: writing smithi20431790-2 from 1196032 to 1867776 tid 1 2024-09-16T04:08:33.904 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:33.904 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:33.905 INFO:tasks.rados.rados.0.smithi204.stdout:151: writing smithi20431790-2 from 1867776 to 2637824 tid 2 2024-09-16T04:08:33.905 INFO:tasks.rados.rados.0.smithi204.stdout:152: setattr oid 50 current snap is 11 2024-09-16T04:08:33.905 INFO:tasks.rados.rados.0.smithi204.stdout:148: finishing rollback tid 1 to smithi20431790-42 2024-09-16T04:08:33.905 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 42 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2024-09-16T04:08:33.905 INFO:tasks.rados.rados.0.smithi204.stdout:149: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-16T04:08:33.919 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:08:33.922 INFO:tasks.rados.rados.0.smithi204.stdout:147: finishing copy_from racing read to smithi20431790-19 2024-09-16T04:08:33.922 INFO:tasks.rados.rados.0.smithi204.stdout:150: expect (ObjNum 61 snap 4 seq_num 61) 2024-09-16T04:08:33.979 INFO:tasks.rados.rados.0.smithi204.stdout:147: finishing copy_from to smithi20431790-19 2024-09-16T04:08:33.979 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 19 v 34 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: finishing write tid 1 to smithi20431790-2 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: finishing write tid 2 to smithi20431790-2 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: finishing write tid 3 to smithi20431790-2 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: finishing write tid 4 to smithi20431790-2 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: oid 2 updating version 0 to 15 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: oid 2 updating version 15 to 17 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: oid 2 version 17 is already newer than 16 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 2 v 17 (ObjNum 85 snap 11 seq_num 85) dirty exists 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:151: left oid 2 (ObjNum 85 snap 11 seq_num 85) 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:147: done (5 left) 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:148: done (4 left) 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:149: done (3 left) 2024-09-16T04:08:33.980 INFO:tasks.rados.rados.0.smithi204.stdout:150: done (2 left) 2024-09-16T04:08:33.981 INFO:tasks.rados.rados.0.smithi204.stdout:151: done (1 left) 2024-09-16T04:08:33.981 INFO:tasks.rados.rados.0.smithi204.stdout:153: copy_from oid 44 from oid 47 current snap is 11 2024-09-16T04:08:33.981 INFO:tasks.rados.rados.0.smithi204.stdout:154: snap_remove snap 4 2024-09-16T04:08:33.994 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:33.991+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:34.034 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.034 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.047 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:08:34.134 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:34.131+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:34.197 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:34.193+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:34.209 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.210 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.222 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:08:34.298 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:34.296+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:34.388 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.388 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.398 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:34.396+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:34.401 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:08:34.499 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:34.497+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:34.518 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.518 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.532 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:08:34.600 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:34.597+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:34.655 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.655 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:08:34.701 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:34.696+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:34.793 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.793 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.802 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:34.800+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:34.809 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:08:34.839 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.11 to 1 (10000) 2024-09-16T04:08:34.841 INFO:tasks.rados.rados.0.smithi204.stdout:154: done (2 left) 2024-09-16T04:08:34.841 INFO:tasks.rados.rados.0.smithi204.stdout:155: read oid 4 snap -1 2024-09-16T04:08:34.841 INFO:tasks.rados.rados.0.smithi204.stdout:155: expect (ObjNum 3 snap 0 seq_num 3) 2024-09-16T04:08:34.841 INFO:tasks.rados.rados.0.smithi204.stdout:156: snap_remove snap 9 2024-09-16T04:08:34.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-16T04:08:34.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-16T04:08:34.903 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:34.898+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:34.940 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:34.940 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:34.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:35.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:35.002+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:35.105 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:35.103+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:35.120 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:35.120 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:35.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:08:35.206 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:35.204+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:35.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:35.256 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:35.257 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:35.271 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:08:35.309 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:35.304+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:35.353 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:35.353 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:35.398 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:35.399 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:35.399 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:35.399 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:35.408 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:35.404+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:35.417 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:35.417 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:35.436 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:35.436 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:35.454 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:35.454 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:35.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:35.454 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:35.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:140 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'98, mlcod=25'93)", 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.268947+0000", 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.180053764, 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002898009, 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.268947+0000", 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.268947+0000", 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.268949+0000", 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3459999999999999e-06 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269002+0000", 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3075999999999998e-05 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269021+0000", 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9590999999999999e-05 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269032+0000", 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029000000000001e-05 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269154+0000", 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121326 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.269209+0000", 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5010999999999999e-05 2024-09-16T04:08:35.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.271760+0000", 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025515109999999998 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.271845+0000", 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5118999999999996e-05 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:178 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'128, mlcod=25'125)", 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.859627867, 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040807439999999999, 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.460 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589375+0000", 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8059999999999999e-06 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589392+0000", 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7215e-05 2024-09-16T04:08:35.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589423+0000", 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0893999999999999e-05 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589449+0000", 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6084e-05 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589544+0000", 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4752000000000004e-05 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589575+0000", 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0914000000000003e-05 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593350+0000", 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037747520000000001 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593454+0000", 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010432700000000001 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:179 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'129, mlcod=25'125)", 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.859181006999997, 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037140540000000001, 2024-09-16T04:08:35.465 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589822+0000", 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5099999999999999e-06 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589904+0000", 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1948999999999998e-05 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589932+0000", 2024-09-16T04:08:35.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8768e-05 2024-09-16T04:08:35.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589950+0000", 2024-09-16T04:08:35.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7484999999999999e-05 2024-09-16T04:08:35.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590036+0000", 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6421999999999994e-05 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590068+0000", 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1324e-05 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593460+0000", 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033925349999999999 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593534+0000", 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4060999999999994e-05 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.472 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:180 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'130, mlcod=25'125)", 2024-09-16T04:08:35.472 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:35.473 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.858605617999999, 2024-09-16T04:08:35.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048385040000000004, 2024-09-16T04:08:35.473 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.473 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590397+0000", 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590411+0000", 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4019000000000001e-05 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590437+0000", 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5604000000000001e-05 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590471+0000", 2024-09-16T04:08:35.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786999999999997e-05 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590878+0000", 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040631400000000001 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590911+0000", 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595170+0000", 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042592050000000003 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595234+0000", 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3921e-05 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:181 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'131, mlcod=25'125)", 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.858200728, 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044790569999999998, 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:35.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590802+0000", 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5370000000000001e-06 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590815+0000", 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2622e-05 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590841+0000", 2024-09-16T04:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5914999999999998e-05 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590857+0000", 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6430999999999999e-05 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591464+0000", 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060738700000000003 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591494+0000", 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9467000000000001e-05 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595239+0000", 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037453709999999999 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595279+0000", 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0327000000000002e-05 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:182 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'132, mlcod=25'125)", 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.857691783, 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051456440000000004, 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.484 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:35.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591311+0000", 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7439999999999999e-06 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591380+0000", 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8540000000000004e-05 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591407+0000", 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7830999999999998e-05 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591427+0000", 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9689000000000001e-05 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592031+0000", 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060361900000000001 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592059+0000", 2024-09-16T04:08:35.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8603999999999999e-05 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596398+0000", 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043381060000000004 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596455+0000", 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7510999999999999e-05 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:183 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'133, mlcod=25'125)", 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.857189812999998, 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046844299999999998, 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:35.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:35.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591813+0000", 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5990000000000001e-06 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591827+0000", 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4012000000000001e-05 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591851+0000", 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3785e-05 2024-09-16T04:08:35.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591867+0000", 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6184999999999998e-05 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592788+0000", 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092107500000000004 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592818+0000", 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0487000000000001e-05 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596460+0000", 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036418240000000001 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596496+0000", 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5463000000000002e-05 2024-09-16T04:08:35.496 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:184 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'134, mlcod=25'126)", 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.856357107000001, 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039075459999999996, 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592646+0000", 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5689999999999999e-06 2024-09-16T04:08:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592687+0000", 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0890000000000003e-05 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592714+0000", 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7433999999999999e-05 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592752+0000", 2024-09-16T04:08:35.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7703000000000001e-05 2024-09-16T04:08:35.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593624+0000", 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087221300000000005 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593657+0000", 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596500+0000", 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028428279999999999 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596552+0000", 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1755000000000002e-05 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:185 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'135, mlcod=25'126)", 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.855791310999997, 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004807703, 2024-09-16T04:08:35.503 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593211+0000", 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593283+0000", 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1697000000000002e-05 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593310+0000", 2024-09-16T04:08:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7427999999999999e-05 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593326+0000", 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6121e-05 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594218+0000", 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089172399999999999 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594251+0000", 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3093999999999999e-05 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597952+0000", 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037006389999999999 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598018+0000", 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5640000000000002e-05 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:186 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'136, mlcod=25'126)", 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.855279396999997, 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043516780000000003, 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593723+0000", 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.674e-06 2024-09-16T04:08:35.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593735+0000", 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1844999999999999e-05 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593766+0000", 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0491e-05 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593785+0000", 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9585e-05 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595361+0000", 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015760870000000001 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595391+0000", 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9974000000000001e-05 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598023+0000", 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00263138 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598073+0000", 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0642000000000001e-05 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.512 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:187 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'137, mlcod=25'126)", 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.854890793999999, 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040215060000000002, 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594112+0000", 2024-09-16T04:08:35.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594125+0000", 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2928000000000001e-05 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594151+0000", 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5860999999999999e-05 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594167+0000", 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6458999999999999e-05 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595892+0000", 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017252299999999999 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595937+0000", 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4246000000000003e-05 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598075+0000", 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002138821 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598132+0000", 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6461e-05 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.518 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:188 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'138, mlcod=25'128)", 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.594947+0000", 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.854054065, 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003368308, 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594947+0000", 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594947+0000", 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594948+0000", 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.376e-06 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595018+0000", 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9534000000000002e-05 2024-09-16T04:08:35.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595045+0000", 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7325e-05 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595062+0000", 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6770999999999999e-05 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596662+0000", 2024-09-16T04:08:35.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015996980000000001 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596704+0000", 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1773000000000001e-05 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598201+0000", 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014978979999999999 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598315+0000", 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011393299999999999 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:189 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'139, mlcod=25'128)", 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.595512+0000", 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.853489615999997, 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034970940000000001, 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.523 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595512+0000", 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595512+0000", 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595513+0000", 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7069999999999999e-06 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595525+0000", 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829e-05 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595558+0000", 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3080000000000002e-05 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595576+0000", 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7382999999999999e-05 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597516+0000", 2024-09-16T04:08:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019402040000000001 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597548+0000", 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2437000000000001e-05 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598929+0000", 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001381141 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.599009+0000", 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9313000000000004e-05 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:35.529 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.50842269, 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055770669999999998, 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940579+0000", 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7e-07 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940742+0000", 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343299999999999 2024-09-16T04:08:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940766+0000", 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3288000000000001e-05 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940779+0000", 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3254999999999999e-05 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0068000000000007e-05 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940868+0000", 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8170000000000005e-06 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946112+0000", 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052441359999999999 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946156+0000", 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3600000000000003e-05 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:35.534 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.508191625999999, 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047930250000000002, 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940832+0000", 2024-09-16T04:08:35.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1430999999999999e-05 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940851+0000", 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8941e-05 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9100000000000005e-06 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940937+0000", 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8448999999999994e-05 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940947+0000", 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.012e-05 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945554+0000", 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046069070000000004 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945603+0000", 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8401e-05 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:35.539 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.507470859000001, 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046535999999999999, 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941531+0000", 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.127e-06 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941561+0000", 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0011000000000001e-05 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941630+0000", 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8071999999999995e-05 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941642+0000", 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2785e-05 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941714+0000", 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1396000000000006e-05 2024-09-16T04:08:35.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941729+0000", 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5656999999999999e-05 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946160+0000", 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044310349999999998 2024-09-16T04:08:35.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946184+0000", 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3516999999999999e-05 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:35.544 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.506751632, 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039380309999999998, 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942275+0000", 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4142999999999999e-05 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942290+0000", 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4929000000000001e-05 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942299+0000", 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8190000000000003e-06 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942409+0000", 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109419 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942417+0000", 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539999999999992e-06 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946142+0000", 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037254079999999999 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946188+0000", 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5123999999999997e-05 2024-09-16T04:08:35.548 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.5955137930000003, 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049795229999999996, 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853488+0000", 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853542+0000", 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3414000000000001e-05 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853571+0000", 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9356000000000002e-05 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853593+0000", 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2022e-05 2024-09-16T04:08:35.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853710+0000", 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011686199999999999 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853729+0000", 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9042000000000002e-05 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856355+0000", 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026263950000000001 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858467+0000", 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021115890000000001 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:35.553 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.5936452580000005, 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060930639999999996, 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:35.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5199999999999998e-07 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855382+0000", 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6024e-05 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855395+0000", 2024-09-16T04:08:35.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2721000000000001e-05 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855403+0000", 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4849999999999992e-06 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858436+0000", 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003033011 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858471+0000", 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4548999999999997e-05 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.861417+0000", 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002946228 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.861449+0000", 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1794000000000001e-05 2024-09-16T04:08:35.557 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.860040+0000", 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.5889612890000002, 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031239589999999999, 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860040+0000", 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860040+0000", 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860041+0000", 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0139999999999999e-06 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860068+0000", 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7115999999999999e-05 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860082+0000", 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3548e-05 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860095+0000", 2024-09-16T04:08:35.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3149999999999999e-05 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860301+0000", 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020588299999999999 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.860330+0000", 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9459e-05 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:35.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.863118+0000", 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027878460000000001 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.863164+0000", 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5942999999999997e-05 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:35.562 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:35.563 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:35.563 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:35.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:08:35.565 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:35.565 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:35.565 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:35.565 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:35.566 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:35.566 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:35.566 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:35.566 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:35.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:35.567 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:35.567 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:35.528+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:35.580 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:35.580 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:35.600 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:35.601 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:35.623 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:35.621+0000 7f28fa7fc640 0 -- 172.21.15.32:0/2257151487 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7f28fc223b50 msgr2=0x7f28fc225f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:35.631 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:35.627+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:35.648 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:35.648 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:35.671 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:35.672 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:35.727 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:35.727 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:35.732 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:35.728+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:35.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:08:35.832 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:35.830+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:35.840 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.12 to 1 (10000) 2024-09-16T04:08:35.841 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-16T04:08:35.843 INFO:tasks.rados.rados.0.smithi204.stdout:156: done (3 left) 2024-09-16T04:08:35.843 INFO:tasks.rados.rados.0.smithi204.stdout:157: read oid 45 snap -1 2024-09-16T04:08:35.843 INFO:tasks.rados.rados.0.smithi204.stdout:157: expect (ObjNum 71 snap 4 seq_num 71) 2024-09-16T04:08:35.843 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 15 current snap is 11 2024-09-16T04:08:35.843 INFO:tasks.rados.rados.0.smithi204.stdout:158: seq_num 86 ranges {1376256=688128,2064384=540672,2605056=229376} 2024-09-16T04:08:35.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-16T04:08:35.880 INFO:tasks.rados.rados.0.smithi204.stdout:158: writing smithi20431790-15 from 1376256 to 2064384 tid 1 2024-09-16T04:08:35.891 INFO:tasks.rados.rados.0.smithi204.stdout:158: writing smithi20431790-15 from 2064384 to 2605056 tid 2 2024-09-16T04:08:35.895 INFO:tasks.rados.rados.0.smithi204.stdout:158: writing smithi20431790-15 from 2605056 to 2834432 tid 3 2024-09-16T04:08:35.895 INFO:tasks.rados.rados.0.smithi204.stdout:159: setattr oid 40 current snap is 11 2024-09-16T04:08:35.898 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 50 v 49 (ObjNum 257 snap 0 seq_num 2595884496) dirty exists 2024-09-16T04:08:35.898 INFO:tasks.rados.rados.0.smithi204.stdout:153: finishing copy_from racing read to smithi20431790-44 2024-09-16T04:08:35.898 INFO:tasks.rados.rados.0.smithi204.stdout:153: finishing copy_from to smithi20431790-44 2024-09-16T04:08:35.898 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 8 (ObjNum 61 snap 4 seq_num 61) dirty exists 2024-09-16T04:08:35.898 INFO:tasks.rados.rados.0.smithi204.stdout:155: expect (ObjNum 3 snap 0 seq_num 3) 2024-09-16T04:08:35.902 INFO:tasks.rados.rados.0.smithi204.stdout:157: expect (ObjNum 71 snap 4 seq_num 71) 2024-09-16T04:08:35.922 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:35.922 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:35.931 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:35.926+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:35.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:08:36.032 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:36.028+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: finishing write tid 1 to smithi20431790-15 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: finishing write tid 2 to smithi20431790-15 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: finishing write tid 3 to smithi20431790-15 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: finishing write tid 4 to smithi20431790-15 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: finishing write tid 5 to smithi20431790-15 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: oid 15 updating version 0 to 50 2024-09-16T04:08:36.068 INFO:tasks.rados.rados.0.smithi204.stdout:158: oid 15 updating version 50 to 52 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:158: oid 15 updating version 52 to 53 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:158: oid 15 version 53 is already newer than 51 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 15 v 53 (ObjNum 86 snap 11 seq_num 86) dirty exists 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:158: left oid 15 (ObjNum 86 snap 11 seq_num 86) 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:152: done (5 left) 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:153: done (4 left) 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:155: done (3 left) 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:157: done (2 left) 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:158: done (1 left) 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 23 current snap is 11 2024-09-16T04:08:36.069 INFO:tasks.rados.rados.0.smithi204.stdout:160: seq_num 87 ranges {376832=704512,1081344=688128,1769472=81920} 2024-09-16T04:08:36.083 INFO:tasks.rados.rados.0.smithi204.stdout:160: writing smithi20431790-23 from 376832 to 1081344 tid 1 2024-09-16T04:08:36.092 INFO:tasks.rados.rados.0.smithi204.stdout:160: writing smithi20431790-23 from 1081344 to 1769472 tid 2 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:160: writing smithi20431790-23 from 1769472 to 1851392 tid 3 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:161: read oid 35 snap -1 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:161: expect (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 5 current snap is 11 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 40 v 27 (ObjNum 77 snap 7 seq_num 77) dirty exists 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:160: finishing write tid 1 to smithi20431790-23 2024-09-16T04:08:36.094 INFO:tasks.rados.rados.0.smithi204.stdout:162: seq_num 88 ranges {540672=720896,1261568=442368,1703936=327680} 2024-09-16T04:08:36.111 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:4, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.934199+0000", 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.174562695999999, 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020115319999999999, 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934199+0000", 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934199+0000", 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934201+0000", 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7099999999999999e-06 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934288+0000", 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7287999999999995e-05 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934353+0000", 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4323000000000001e-05 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934381+0000", 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8351999999999999e-05 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934782+0000", 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040130899999999998 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934823+0000", 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0964999999999998e-05 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936121+0000", 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012980299999999999 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936211+0000", 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9555000000000006e-05 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 33/31 ECSubWrite(tid=1, reqid=client.4631.0:5, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.935277+0000", 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.173485479, 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017255440000000001, 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935277+0000", 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935277+0000", 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935278+0000", 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0109999999999999e-06 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935300+0000", 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2093e-05 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935312+0000", 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2223e-05 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935321+0000", 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.704e-06 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935689+0000", 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036883100000000002 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935713+0000", 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3189000000000001e-05 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936959+0000", 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012460920000000001 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.937002+0000", 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3401e-05 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s6 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940654+0000", 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.168107571, 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015572920000000001, 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940654+0000", 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940654+0000", 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940655+0000", 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7299999999999995e-07 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940853+0000", 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019818799999999999 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940884+0000", 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0580999999999997e-05 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940907+0000", 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2799e-05 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941043+0000", 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013609900000000001 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941058+0000", 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5702999999999999e-05 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942173+0000", 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001114933 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942212+0000", 2024-09-16T04:08:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8315999999999997e-05 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 34/31 ECSubWrite(tid=0, reqid=client.4631.0:31, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.949316+0000", 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.159446159000002, 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001502853, 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949316+0000", 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949316+0000", 2024-09-16T04:08:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949318+0000", 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9630000000000001e-06 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949407+0000", 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8900000000000006e-05 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949432+0000", 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5493000000000001e-05 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949445+0000", 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3166999999999999e-05 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949535+0000", 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9517000000000004e-05 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949546+0000", 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0946e-05 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950766+0000", 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001220123 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950819+0000", 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2744000000000002e-05 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 34/31 ECSubWrite(tid=0, reqid=client.4631.0:34, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.953683+0000", 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.155079338, 2024-09-16T04:08:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016285830000000001, 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.953683+0000", 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.953683+0000", 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.953683+0000", 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.66e-07 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.954087+0000", 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040389799999999997 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.954120+0000", 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3342e-05 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.954153+0000", 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3130999999999998e-05 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.954274+0000", 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012100900000000001 2024-09-16T04:08:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.954288+0000", 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3311e-05 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955265+0000", 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097744699999999999 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955311+0000", 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6279000000000002e-05 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 34/31 ECSubWrite(tid=2, reqid=client.4631.0:32, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.963993+0000", 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.144769232000002, 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015884709999999999, 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963993+0000", 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963993+0000", 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963995+0000", 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964022+0000", 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7029000000000002e-05 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964060+0000", 2024-09-16T04:08:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8704000000000001e-05 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964084+0000", 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3269e-05 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964248+0000", 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016437299999999999 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964272+0000", 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3411999999999999e-05 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.965542+0000", 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012707479999999999 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.965581+0000", 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8952999999999998e-05 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s6 34/31 ECSubWrite(tid=176, reqid=client.4631.0:94, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.012228+0000", 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.096534171999998, 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001711008, 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012228+0000", 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012228+0000", 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012229+0000", 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3e-06 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012577+0000", 2024-09-16T04:08:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034767499999999998 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012597+0000", 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0217999999999999e-05 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012608+0000", 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1167e-05 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012712+0000", 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103396 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.012724+0000", 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2207e-05 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.013889+0000", 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011656419999999999 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.013939+0000", 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9403000000000001e-05 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 34/31 ECSubWrite(tid=25, reqid=client.4631.0:100, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.021123+0000", 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.087638902999998, 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017705729999999999, 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021123+0000", 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021123+0000", 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021124+0000", 2024-09-16T04:08:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.11e-06 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021389+0000", 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026487599999999999 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021411+0000", 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1903999999999999e-05 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021422+0000", 2024-09-16T04:08:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1221e-05 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021517+0000", 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5303999999999994e-05 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021528+0000", 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0254999999999999e-05 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.022854+0000", 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001326348 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.022894+0000", 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9555000000000003e-05 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.7s3 34/31 ECSubWrite(tid=4, reqid=client.4631.0:115, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.039964+0000", 2024-09-16T04:08:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.068797731, 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015184280000000001, 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039964+0000", 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039964+0000", 2024-09-16T04:08:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039965+0000", 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1699999999999998e-07 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040395+0000", 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042971900000000001 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040410+0000", 2024-09-16T04:08:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5342999999999999e-05 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040420+0000", 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0188e-05 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040490+0000", 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0275000000000001e-05 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040502+0000", 2024-09-16T04:08:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1286e-05 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041444+0000", 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000942205 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041483+0000", 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8794999999999997e-05 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 34/31 ECSubWrite(tid=12, reqid=client.4631.0:121, at_version=34'7, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.047994+0000", 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.060768207999999, 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015398219999999999, 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.047994+0000", 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.047994+0000", 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.047995+0000", 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.522e-06 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.048553+0000", 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055756000000000002 2024-09-16T04:08:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.048576+0000", 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3402999999999999e-05 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.048587+0000", 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1076e-05 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.048656+0000", 2024-09-16T04:08:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8627999999999994e-05 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.048663+0000", 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9260000000000003e-06 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049487+0000", 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082373099999999996 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049534+0000", 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6975999999999999e-05 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 34/31 ECSubWrite(tid=14, reqid=client.4631.0:124, at_version=34'9, trim_to=0'0, roll_forward_to=34'7))", 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.052466+0000", 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.056295819999999, 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001643701, 2024-09-16T04:08:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.052466+0000", 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.052466+0000", 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.052467+0000", 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2440000000000001e-06 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.053078+0000", 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061105000000000003 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.053099+0000", 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0366000000000001e-05 2024-09-16T04:08:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.053109+0000", 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.066e-05 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.053179+0000", 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9826999999999994e-05 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.053191+0000", 2024-09-16T04:08:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1843e-05 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.054083+0000", 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000892007 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.054110+0000", 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6704e-05 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 34/31 ECSubWrite(tid=20, reqid=client.4631.0:130, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.064478+0000", 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.044284107999999, 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001529615, 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064478+0000", 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064478+0000", 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064479+0000", 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.387e-06 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064873+0000", 2024-09-16T04:08:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039406499999999998 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064896+0000", 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2742999999999999e-05 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064908+0000", 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2203e-05 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064985+0000", 2024-09-16T04:08:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6563000000000005e-05 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.064995+0000", 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.06e-05 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.065975+0000", 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097981299999999995 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.066007+0000", 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2240999999999998e-05 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=20, reqid=client.4631.0:188, at_version=39'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.110496309, 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040184299999999999, 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2300000000000001e-07 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998524+0000", 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000257564 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998556+0000", 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990999999999999e-05 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998574+0000", 2024-09-16T04:08:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7768999999999999e-05 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998779+0000", 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020545399999999999 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998807+0000", 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7620999999999999e-05 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002192+0000", 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033852890000000001 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002284+0000", 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2119000000000004e-05 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=21, reqid=client.4631.0:189, at_version=39'7, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.105953252999999, 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032263890000000001, 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002810+0000", 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.736e-06 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003033+0000", 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022254499999999999 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003074+0000", 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1038000000000002e-05 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003098+0000", 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3805999999999999e-05 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003258+0000", 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016002799999999999 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003292+0000", 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4155000000000001e-05 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005933+0000", 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026408299999999998 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006035+0000", 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010225099999999999 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=22, reqid=client.4631.0:190, at_version=39'8, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:22.005080+0000", 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.103681734, 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001624889, 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005080+0000", 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005080+0000", 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005082+0000", 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.95e-06 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005129+0000", 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6434000000000003e-05 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005163+0000", 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4771999999999998e-05 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005202+0000", 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8523999999999999e-05 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005467+0000", 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026494000000000002 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005497+0000", 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0307999999999998e-05 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006609+0000", 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011123089999999999 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006705+0000", 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5651999999999998e-05 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=23, reqid=client.4631.0:190, at_version=0'0, trim_to=0'0, roll_forward_to=39'8))", 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:22.010002+0000", 2024-09-16T04:08:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.098760249, 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00191584, 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010002+0000", 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010002+0000", 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010004+0000", 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.877e-06 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010031+0000", 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7864999999999998e-05 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010074+0000", 2024-09-16T04:08:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2104000000000002e-05 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010092+0000", 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8219e-05 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010256+0000", 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016385600000000001 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010286+0000", 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0037999999999999e-05 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.011800+0000", 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015143240000000001 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.011918+0000", 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117557 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 44/31 ECSubWrite(tid=48, reqid=client.4631.0:302, at_version=44'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:27.041593+0000", 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.0671685859999993, 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025847079999999998, 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041593+0000", 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041593+0000", 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041594+0000", 2024-09-16T04:08:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8599999999999999e-07 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041997+0000", 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040302300000000002 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042017+0000", 2024-09-16T04:08:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0505000000000001e-05 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042030+0000", 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.238e-05 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042760+0000", 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073047900000000002 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042771+0000", 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.066e-05 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.044123+0000", 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013526429999999999 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.044178+0000", 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4632000000000001e-05 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 48/31 ECSubWrite(tid=59, reqid=osd.12.0:59, at_version=48'21, trim_to=0'0, roll_forward_to=47'19))", 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.843583+0000", 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.265178669, 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001665904, 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843583+0000", 2024-09-16T04:08:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843583+0000", 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843584+0000", 2024-09-16T04:08:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-07 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843661+0000", 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6940000000000005e-05 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843718+0000", 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7601e-05 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843748+0000", 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9685000000000001e-05 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.843999+0000", 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000251408 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.844021+0000", 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1895999999999998e-05 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.845200+0000", 2024-09-16T04:08:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178199 2024-09-16T04:08:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.845249+0000", 2024-09-16T04:08:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9685000000000003e-05 2024-09-16T04:08:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.2546862860000001, 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020743480000000002, 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8999999999999996e-07 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854151+0000", 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4530000000000006e-05 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854184+0000", 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2888000000000001e-05 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854207+0000", 2024-09-16T04:08:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2806000000000002e-05 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854390+0000", 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018299200000000001 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854407+0000", 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7646e-05 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856057+0000", 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016492970000000001 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856150+0000", 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3498999999999994e-05 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854455+0000", 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.2543066190000003, 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034971920000000001, 2024-09-16T04:08:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854455+0000", 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854455+0000", 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854456+0000", 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6700000000000003e-07 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854509+0000", 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3204000000000001e-05 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854539+0000", 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9606000000000001e-05 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854560+0000", 2024-09-16T04:08:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0576000000000001e-05 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854824+0000", 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026413499999999998 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854850+0000", 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6486e-05 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.857902+0000", 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00305193 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.857953+0000", 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0488000000000002e-05 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.208 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:36.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:08:36.211 INFO:tasks.rados.rados.0.smithi204.stdout:162: writing smithi20431790-5 from 540672 to 1261568 tid 1 2024-09-16T04:08:36.211 INFO:tasks.rados.rados.0.smithi204.stdout:162: writing smithi20431790-5 from 1261568 to 1703936 tid 2 2024-09-16T04:08:36.211 INFO:tasks.rados.rados.0.smithi204.stdout:162: writing smithi20431790-5 from 1703936 to 2031616 tid 3 2024-09-16T04:08:36.211 INFO:tasks.rados.rados.0.smithi204.stdout:159: done (3 left) 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 49 current snap is 11 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:163: seq_num 89 ranges {2146304=737280,2883584=573440,3457024=196608} 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:163: writing smithi20431790-49 from 2146304 to 2883584 tid 1 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:163: writing smithi20431790-49 from 2883584 to 3457024 tid 2 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:163: writing smithi20431790-49 from 3457024 to 3653632 tid 3 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:164: read oid 13 snap -1 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:164: expect (ObjNum 83 snap 8 seq_num 83) 2024-09-16T04:08:36.212 INFO:tasks.rados.rados.0.smithi204.stdout:165: snap_remove snap 7 2024-09-16T04:08:36.213 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:36.203+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:36.311 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:36.308+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:36.336 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:36.336 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:36.337 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:36.337 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:36.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:08:36.411 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:36.407+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:36.475 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:36.475 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:36.475 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:36.475 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:36.475 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:36.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:08:36.513 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:36.507+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:36.614 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:36.611+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:4 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~32768,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.685894101999999, 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013185643, 2024-09-16T04:08:36.622 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 4 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932527+0000", 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8419999999999999e-06 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932624+0000", 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6569000000000003e-05 2024-09-16T04:08:36.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932639+0000", 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5235000000000001e-05 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932649+0000", 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9170000000000001e-06 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932741+0000", 2024-09-16T04:08:36.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2386999999999995e-05 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932935+0000", 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019349300000000001 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933686+0000", 2024-09-16T04:08:36.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000751397 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935325+0000", 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016391139999999999 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945629+0000", 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010304015999999999 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945711+0000", 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1673000000000002e-05 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:5 3.es0 3:7eb60d01:::smithi20431790-2:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.685742140999999, 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023042435, 2024-09-16T04:08:36.628 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 5 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932678+0000", 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3900000000000005e-07 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932681+0000", 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9380000000000001e-06 2024-09-16T04:08:36.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932688+0000", 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0190000000000001e-06 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932693+0000", 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0470000000000001e-06 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934299+0000", 2024-09-16T04:08:36.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016061459999999999 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934403+0000", 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104053 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934949+0000", 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054629899999999998 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.937424+0000", 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024750050000000002 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955463+0000", 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018038200000000001 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955720+0000", 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025718900000000001 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:6 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.685697655999999, 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033670261999999999, 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 6 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.15e-07 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932731+0000", 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5450000000000003e-06 2024-09-16T04:08:36.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932738+0000", 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7630000000000003e-06 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932743+0000", 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.13e-06 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935222+0000", 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002479621 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935313+0000", 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0717999999999994e-05 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956695+0000", 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021382437000000001 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956983+0000", 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028708299999999999 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966392+0000", 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094095499999999992 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 33/31 ECSubWrite(tid=1, reqid=client.4631.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.941481+0000", 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.676938053000001, 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005447782, 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941481+0000", 2024-09-16T04:08:36.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941481+0000", 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941482+0000", 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1800000000000001e-07 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.944725+0000", 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032427620000000002 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945764+0000", 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010393379999999999 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945777+0000", 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2911999999999999e-05 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945904+0000", 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126859 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945915+0000", 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0964999999999999e-05 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946885+0000", 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097043599999999998 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946929+0000", 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4091999999999997e-05 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as4 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942085+0000", 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.676334015999998, 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021663379999999999, 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942085+0000", 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942085+0000", 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942086+0000", 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.33e-07 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942725+0000", 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063902299999999996 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942743+0000", 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7808999999999998e-05 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942753+0000", 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3109999999999995e-06 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942904+0000", 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000151557 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942916+0000", 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2063e-05 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.944209+0000", 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001292687 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.944252+0000", 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2954999999999998e-05 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as4 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942775+0000", 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.675644748, 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021744149999999999, 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942775+0000", 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942775+0000", 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942775+0000", 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3600000000000004e-07 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942796+0000", 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1140000000000001e-05 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942808+0000", 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562e-05 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942816+0000", 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0339999999999997e-06 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.943438+0000", 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062215100000000004 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.943448+0000", 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0093e-05 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.944904+0000", 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014554640000000001 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.944949+0000", 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5435000000000001e-05 2024-09-16T04:08:36.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWriteReply(3.es0 33/31 ECSubWriteReply(tid=1, last_complete=33'2, committed=1, applied=1))", 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.955054+0000", 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.663365042999999, 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001494294, 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955054+0000", 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955054+0000", 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955055+0000", 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4099999999999997e-07 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955060+0000", 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955074+0000", 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3953e-05 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955083+0000", 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.867e-06 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955233+0000", 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000150638 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956549+0000", 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013154530000000001 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWriteReply(3.es0 34/31 ECSubWriteReply(tid=2, last_complete=33'2, committed=1, applied=1))", 2024-09-16T04:08:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.957544+0000", 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.660875857000001, 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016019109999999999, 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.957544+0000", 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.957544+0000", 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.957545+0000", 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.052e-06 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.957551+0000", 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9950000000000002e-06 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.957567+0000", 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6218999999999998e-05 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.957578+0000", 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0617e-05 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.959127+0000", 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015490129999999999 2024-09-16T04:08:36.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.959146+0000", 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9015e-05 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.7s1 34/31 ECSubWrite(tid=4, reqid=client.4631.0:115, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.040107+0000", 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.578312962999998, 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001662565, 2024-09-16T04:08:36.660 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040107+0000", 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040107+0000", 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040107+0000", 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2399999999999999e-07 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040928+0000", 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082081600000000004 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040944+0000", 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6418000000000001e-05 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.040954+0000", 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8789999999999998e-06 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041026+0000", 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1878000000000005e-05 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041032+0000", 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041728+0000", 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069587999999999996 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041769+0000", 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1455000000000002e-05 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.664 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:139 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~786432,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.542696461999999, 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067777820000000004, 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075725+0000", 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.807e-06 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077516+0000", 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017915439999999999 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077542+0000", 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6095999999999999e-05 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077554+0000", 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1092e-05 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077624+0000", 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9941e-05 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077802+0000", 2024-09-16T04:08:36.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017843199999999999 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.079111+0000", 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00130955 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081291+0000", 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00217986 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:36.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082420+0000", 2024-09-16T04:08:36.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001128642 2024-09-16T04:08:36.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082501+0000", 2024-09-16T04:08:36.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0817999999999998e-05 2024-09-16T04:08:36.672 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.672 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:140 3.es0 3:7eff5f99:::smithi20431790-47:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.077585+0000", 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.540834051000001, 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060159829999999999, 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:36.673 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077585+0000", 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077585+0000", 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077587+0000", 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.082e-06 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077592+0000", 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0730000000000004e-06 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077601+0000", 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3300000000000005e-06 2024-09-16T04:08:36.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077608+0000", 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6039999999999998e-06 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080365+0000", 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027578220000000001 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080479+0000", 2024-09-16T04:08:36.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011374699999999999 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080985+0000", 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050615199999999995 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082773+0000", 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017874399999999999 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:36.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083515+0000", 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074210900000000002 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083601+0000", 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6624000000000003e-05 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:141 3.es0 3:7eff5f99:::smithi20431790-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:08:36.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.540801260999999, 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077419300000000002, 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:08:36.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077619+0000", 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1200000000000003e-07 2024-09-16T04:08:36.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077622+0000", 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5599999999999998e-06 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077630+0000", 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7719999999999994e-06 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077636+0000", 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4689999999999996e-06 2024-09-16T04:08:36.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081205+0000", 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003569773 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081284+0000", 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8584000000000005e-05 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083920+0000", 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026361890000000002 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.084003+0000", 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2714999999999997e-05 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.085360+0000", 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013573560000000001 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.5s6 34/31 ECSubWrite(tid=24, reqid=client.4631.0:142, at_version=34'7, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.080437+0000", 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.537982607, 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002562398, 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080437+0000", 2024-09-16T04:08:36.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080437+0000", 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080438+0000", 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1230000000000001e-06 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080547+0000", 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108929 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080600+0000", 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2639000000000002e-05 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080631+0000", 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1791000000000001e-05 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080723+0000", 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1189999999999999e-05 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080732+0000", 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8789999999999998e-06 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082942+0000", 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022091889999999999 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082999+0000", 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7658000000000003e-05 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.5s6 34/31 ECSubWrite(tid=27, reqid=client.4631.0:144, at_version=0'0, trim_to=0'0, roll_forward_to=34'9))", 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.086842+0000", 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.531577667000001, 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014853449999999999, 2024-09-16T04:08:36.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.086842+0000", 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.086842+0000", 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.086843+0000", 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0100000000000004e-07 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.086859+0000", 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6364000000000001e-05 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.086920+0000", 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0999999999999999e-05 2024-09-16T04:08:36.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.086939+0000", 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9471999999999999e-05 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.087092+0000", 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015205700000000001 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.087101+0000", 2024-09-16T04:08:36.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2920000000000001e-06 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.088300+0000", 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001199484 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.088327+0000", 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6874999999999999e-05 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as4 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854166+0000", 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7642530289999998, 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047152909999999999, 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854166+0000", 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854166+0000", 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854167+0000", 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8099999999999999e-07 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854197+0000", 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0652999999999999e-05 2024-09-16T04:08:36.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854214+0000", 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6880000000000001e-05 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854227+0000", 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2356e-05 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854789+0000", 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056211599999999998 2024-09-16T04:08:36.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854803+0000", 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4615e-05 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858829+0000", 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00402572 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858882+0000", 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2670000000000002e-05 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 48/31 ECSubWrite(tid=144, reqid=osd.10.0:144, at_version=48'64, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854428+0000", 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7639917470000004, 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030461939999999999, 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854428+0000", 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854428+0000", 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854428+0000", 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8700000000000002e-07 2024-09-16T04:08:36.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854456+0000", 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7574000000000001e-05 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854472+0000", 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6307000000000002e-05 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854482+0000", 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0549e-05 2024-09-16T04:08:36.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854599+0000", 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011615799999999999 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854611+0000", 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2841e-05 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.857432+0000", 2024-09-16T04:08:36.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002820216 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.857474+0000", 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2262000000000003e-05 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.855323+0000", 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7630967230000003, 2024-09-16T04:08:36.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033379410000000001, 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855323+0000", 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855323+0000", 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855324+0000", 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4600000000000003e-07 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855349+0000", 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4799000000000001e-05 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855365+0000", 2024-09-16T04:08:36.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6796999999999999e-05 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855377+0000", 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1578e-05 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856220+0000", 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00084320399999999996 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856232+0000", 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1586000000000001e-05 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858615+0000", 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002382927 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858661+0000", 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6103999999999998e-05 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 53/31 ECSubWrite(tid=171, reqid=osd.10.0:171, at_version=53'78, trim_to=0'0, roll_forward_to=52'76))", 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:35.862711+0000", 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.75570819, 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021211759999999998, 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862711+0000", 2024-09-16T04:08:36.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862711+0000", 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862712+0000", 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3300000000000001e-07 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862753+0000", 2024-09-16T04:08:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1272000000000001e-05 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862796+0000", 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2982000000000003e-05 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862812+0000", 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5787e-05 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862916+0000", 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104094 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.862928+0000", 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2728000000000001e-05 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.864798+0000", 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018692509999999999 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:35.864832+0000", 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4829000000000001e-05 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 53/31 ECSubWrite(tid=173, reqid=client.4631.0:422, at_version=53'80, trim_to=0'0, roll_forward_to=53'78))", 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:36.118853+0000", 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.49956610000000001, 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028173429999999999, 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.710 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.118853+0000", 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.118853+0000", 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.118855+0000", 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0109999999999999e-06 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.119364+0000", 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050848899999999999 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.119382+0000", 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8425999999999999e-05 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.119392+0000", 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9550000000000004e-06 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.119525+0000", 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317400000000001 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.119549+0000", 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3802e-05 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.121633+0000", 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020834400000000002 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.121671+0000", 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8046000000000001e-05 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 53/31 ECSubWrite(tid=175, reqid=client.4631.0:424, at_version=53'82, trim_to=0'0, roll_forward_to=53'80))", 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:36.128626+0000", 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.48979302200000002, 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018412420000000001, 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128626+0000", 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128626+0000", 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128628+0000", 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128710+0000", 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1797000000000003e-05 2024-09-16T04:08:36.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128740+0000", 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0226000000000002e-05 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128757+0000", 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.626e-05 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128904+0000", 2024-09-16T04:08:36.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014730400000000001 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.128934+0000", 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0658999999999999e-05 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.130392+0000", 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014574480000000001 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.130468+0000", 2024-09-16T04:08:36.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5767999999999997e-05 2024-09-16T04:08:36.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:36.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:36.719 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:36.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:08:36.721 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:36.716+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:36.822 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:36.815+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:36.850 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:36.850 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:36.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:08:36.923 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:36.919+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:36.988 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:36.989 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:36.989 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:36.989 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:36.989 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:37.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:08:37.023 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:37.018+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:37.060 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.13 to 1 (10000) 2024-09-16T04:08:37.063 INFO:tasks.rados.rados.0.smithi204.stdout:165: done (5 left) 2024-09-16T04:08:37.064 INFO:tasks.rados.rados.0.smithi204.stdout:166: snap_create 2024-09-16T04:08:37.064 INFO:tasks.rados.rados.0.smithi204.stdout:160: finishing write tid 2 to smithi20431790-23 2024-09-16T04:08:37.064 INFO:tasks.rados.rados.0.smithi204.stdout:160: finishing write tid 3 to smithi20431790-23 2024-09-16T04:08:37.064 INFO:tasks.rados.rados.0.smithi204.stdout:160: finishing write tid 4 to smithi20431790-23 2024-09-16T04:08:37.064 INFO:tasks.rados.rados.0.smithi204.stdout:161: expect (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:37.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-16T04:08:37.100 INFO:tasks.rados.rados.0.smithi204.stdout:160: finishing write tid 5 to smithi20431790-23 2024-09-16T04:08:37.100 INFO:tasks.rados.rados.0.smithi204.stdout:160: oid 23 updating version 0 to 5 2024-09-16T04:08:37.100 INFO:tasks.rados.rados.0.smithi204.stdout:160: oid 23 updating version 5 to 6 2024-09-16T04:08:37.100 INFO:tasks.rados.rados.0.smithi204.stdout:160: oid 23 version 6 is already newer than 4 2024-09-16T04:08:37.100 INFO:tasks.rados.rados.0.smithi204.stdout:160: oid 23 updating version 6 to 7 2024-09-16T04:08:37.101 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 23 v 7 (ObjNum 87 snap 11 seq_num 87) dirty exists 2024-09-16T04:08:37.101 INFO:tasks.rados.rados.0.smithi204.stdout:160: left oid 23 (ObjNum 87 snap 11 seq_num 87) 2024-09-16T04:08:37.101 INFO:tasks.rados.rados.0.smithi204.stdout:162: finishing write tid 1 to smithi20431790-5 2024-09-16T04:08:37.101 INFO:tasks.rados.rados.0.smithi204.stdout:162: finishing write tid 2 to smithi20431790-5 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: finishing write tid 3 to smithi20431790-5 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: finishing write tid 4 to smithi20431790-5 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: finishing write tid 5 to smithi20431790-5 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: oid 5 updating version 0 to 81 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: oid 5 version 81 is already newer than 80 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: oid 5 updating version 81 to 82 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:162: oid 5 updating version 82 to 83 2024-09-16T04:08:37.102 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 83 (ObjNum 88 snap 11 seq_num 88) dirty exists 2024-09-16T04:08:37.103 INFO:tasks.rados.rados.0.smithi204.stdout:162: left oid 5 (ObjNum 88 snap 11 seq_num 88) 2024-09-16T04:08:37.103 INFO:tasks.rados.rados.0.smithi204.stdout:163: finishing write tid 1 to smithi20431790-49 2024-09-16T04:08:37.103 INFO:tasks.rados.rados.0.smithi204.stdout:163: finishing write tid 2 to smithi20431790-49 2024-09-16T04:08:37.103 INFO:tasks.rados.rados.0.smithi204.stdout:163: finishing write tid 3 to smithi20431790-49 2024-09-16T04:08:37.103 INFO:tasks.rados.rados.0.smithi204.stdout:163: finishing write tid 4 to smithi20431790-49 2024-09-16T04:08:37.103 INFO:tasks.rados.rados.0.smithi204.stdout:164: expect (ObjNum 83 snap 8 seq_num 83) 2024-09-16T04:08:37.124 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:37.118+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:163: finishing write tid 5 to smithi20431790-49 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:163: oid 49 updating version 0 to 58 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:163: oid 49 version 58 is already newer than 57 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:163: oid 49 updating version 58 to 59 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:163: oid 49 updating version 59 to 60 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 60 (ObjNum 89 snap 11 seq_num 89) dirty exists 2024-09-16T04:08:37.136 INFO:tasks.rados.rados.0.smithi204.stdout:163: left oid 49 (ObjNum 89 snap 11 seq_num 89) 2024-09-16T04:08:37.145 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:37.145 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:37.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:31 3.9s0 3:93634e21:::smithi20431790-11:head [append 0~180224,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.194411666000001, 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015779225000000001, 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 31 2024-09-16T04:08:37.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:37.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947688+0000", 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.599e-06 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948028+0000", 2024-09-16T04:08:37.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000340491 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948040+0000", 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1488000000000001e-05 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948046+0000", 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948165+0000", 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011934000000000001 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948369+0000", 2024-09-16T04:08:37.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020333999999999999 2024-09-16T04:08:37.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949522+0000", 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001153435 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951355+0000", 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001833386 2024-09-16T04:08:37.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963404+0000", 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012048644000000001 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963464+0000", 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0044999999999999e-05 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:32 3.9s0 3:93634e21:::smithi20431790-11:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:37.154 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.194028974999998, 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015702510999999999, 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.156 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.156 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 32 2024-09-16T04:08:37.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.156 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2600000000000002e-07 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948073+0000", 2024-09-16T04:08:37.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6700000000000002e-06 2024-09-16T04:08:37.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948082+0000", 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-06 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948090+0000", 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9729999999999997e-06 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950170+0000", 2024-09-16T04:08:37.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020803670000000001 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950297+0000", 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127062 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950926+0000", 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062826500000000003 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951904+0000", 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000978694 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963618+0000", 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011714096 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963770+0000", 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015180799999999999 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.162 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:33 3.9s0 3:93634e21:::smithi20431790-11:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.193973042, 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018249636999999999, 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 33 2024-09-16T04:08:37.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948125+0000", 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.159e-06 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948130+0000", 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5559999999999998e-06 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948145+0000", 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5057e-05 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948155+0000", 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7040000000000006e-06 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951232+0000", 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077069 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951336+0000", 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103558 2024-09-16T04:08:37.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964171+0000", 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012834887999999999 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964283+0000", 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112611 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966373+0000", 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020900350000000001 2024-09-16T04:08:37.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:97 3.0s0 3:0daec8ce:::smithi20431790-33:head [append 0~540672,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.014873+0000", 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.127224027, 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060881340000000003, 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 97 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.014873+0000", 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.014873+0000", 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.014875+0000", 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0090000000000002e-06 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015314+0000", 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000439531 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015336+0000", 2024-09-16T04:08:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2225000000000002e-05 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015349+0000", 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2242000000000001e-05 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015424+0000", 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4950999999999994e-05 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015529+0000", 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010540299999999999 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.016365+0000", 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083623599999999997 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018662+0000", 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022967030000000002 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.020904+0000", 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022418849999999999 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.020961+0000", 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6949e-05 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:98 3.0s0 3:0daec8ce:::smithi20431790-33:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.173 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.015377+0000", 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.126719125000001, 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060898829999999999, 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 98 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015377+0000", 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015377+0000", 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015378+0000", 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6899999999999996e-07 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015383+0000", 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9230000000000001e-06 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015405+0000", 2024-09-16T04:08:37.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1662999999999999e-05 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015413+0000", 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0399999999999993e-06 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.017323+0000", 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001909808 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.017444+0000", 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105200000000001 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.017882+0000", 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043772499999999997 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018687+0000", 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080527500000000004 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021370+0000", 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026832639999999999 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021467+0000", 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7263999999999996e-05 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:99 3.0s0 3:0daec8ce:::smithi20431790-33:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.126669811999999, 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008043718, 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.180 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 99 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0299999999999999e-07 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015431+0000", 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9940000000000002e-06 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015441+0000", 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015448+0000", 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018104+0000", 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026563300000000001 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018194+0000", 2024-09-16T04:08:37.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9544999999999997e-05 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021888+0000", 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036945709999999998 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.022023+0000", 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013508899999999999 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.023471+0000", 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001447343 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:109 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~606208,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.11181328, 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069726889999999998, 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.185 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 109 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030285+0000", 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8330000000000001e-06 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030998+0000", 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071285399999999996 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031011+0000", 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2935000000000001e-05 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031017+0000", 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031073+0000", 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6746999999999997e-05 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031204+0000", 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013035600000000001 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032021+0000", 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081749100000000005 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033799+0000", 2024-09-16T04:08:37.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001777666 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037138+0000", 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00333943 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037256+0000", 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117754 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:110 3.9s0 3:9410ed93:::smithi20431790-37:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.031035+0000", 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.111061464999999, 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064136970000000003, 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 110 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031035+0000", 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031035+0000", 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031036+0000", 2024-09-16T04:08:37.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9699999999999995e-07 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031040+0000", 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3880000000000002e-06 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031049+0000", 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2339999999999994e-06 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031055+0000", 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0079999999999999e-06 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032513+0000", 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014581279999999999 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032621+0000", 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108658 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033187+0000", 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056515500000000002 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.034255+0000", 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001068463 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037364+0000", 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031091529999999999 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037449+0000", 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4713e-05 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:111 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.111032304999998, 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085961969999999999, 2024-09-16T04:08:37.196 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031065+0000", 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0100000000000005e-07 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031067+0000", 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:08:37.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031075+0000", 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.498e-06 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031080+0000", 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3159999999999996e-06 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033632+0000", 2024-09-16T04:08:37.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025523619999999999 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033720+0000", 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7457e-05 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037855+0000", 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041353259999999999 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037942+0000", 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7039999999999993e-05 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039661+0000", 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001718327 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:118 3.0s0 3:04de99e5:::smithi20431790-40:head [append 0~671744,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:37.201 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.100111776999999, 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078732079999999996, 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 118 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:37.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041987+0000", 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042717+0000", 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073003100000000002 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042741+0000", 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4037e-05 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042755+0000", 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3828e-05 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042940+0000", 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018496100000000001 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.043139+0000", 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019973899999999999 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044207+0000", 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001067822 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045575+0000", 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013682729999999999 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049772+0000", 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041967660000000002 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049858+0000", 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5833000000000003e-05 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:119 3.0s0 3:04de99e5:::smithi20431790-40:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.099309589000001, 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072748409999999998, 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.207 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 119 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042788+0000", 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.031e-06 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042794+0000", 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5969999999999999e-06 2024-09-16T04:08:37.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042805+0000", 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1375999999999999e-05 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042812+0000", 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.613e-06 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044774+0000", 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019619059999999998 2024-09-16T04:08:37.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044887+0000", 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011298600000000001 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045362+0000", 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047594299999999999 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045858+0000", 2024-09-16T04:08:37.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000495193 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049963+0000", 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041055500000000003 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050062+0000", 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8646000000000004e-05 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:120 3.0s0 3:04de99e5:::smithi20431790-40:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.099274594000001, 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091318960000000005, 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 120 2024-09-16T04:08:37.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042823+0000", 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0699999999999997e-07 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042825+0000", 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.441e-06 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042834+0000", 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4099999999999997e-06 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042840+0000", 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.728e-06 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045635+0000", 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027951059999999999 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045745+0000", 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109392 2024-09-16T04:08:37.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050479+0000", 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047341659999999997 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050579+0000", 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9852999999999994e-05 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.051954+0000", 2024-09-16T04:08:37.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013752930000000001 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:136 3.0s0 3:0316444d:::smithi20431790-46:head [append 0~770048,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.071281313, 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006793075, 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070817+0000", 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.911e-06 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071720+0000", 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00090319599999999999 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071743+0000", 2024-09-16T04:08:37.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3003e-05 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071755+0000", 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1157e-05 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071832+0000", 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7206999999999994e-05 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071946+0000", 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114251 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.072639+0000", 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069292699999999997 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074184+0000", 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015451639999999999 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077540+0000", 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556760000000001 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077608+0000", 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8583000000000004e-05 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:137 3.0s0 3:0316444d:::smithi20431790-46:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.223 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071782+0000", 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.070314328999999, 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067502279999999996, 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071782+0000", 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071782+0000", 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071783+0000", 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999997e-07 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071789+0000", 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2260000000000002e-06 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071800+0000", 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.078e-05 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071807+0000", 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7789999999999998e-06 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.073234+0000", 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014268620000000001 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.073293+0000", 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9358000000000003e-05 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.073818+0000", 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052522400000000003 2024-09-16T04:08:37.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074285+0000", 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046693199999999998 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078459+0000", 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041739710000000003 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078533+0000", 2024-09-16T04:08:37.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3209999999999999e-05 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:138 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.070276442000001, 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098477340000000003, 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.229 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071821+0000", 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0399999999999996e-07 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071824+0000", 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9639999999999999e-06 2024-09-16T04:08:37.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071833+0000", 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7879999999999995e-06 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071839+0000", 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9959999999999999e-06 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074071+0000", 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022326329999999999 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074173+0000", 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101989 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078912+0000", 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047384030000000004 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078998+0000", 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6192000000000004e-05 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081668+0000", 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002670165 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:188 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~589824] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:08:37.234 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.151807916999999, 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016933011000000001, 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 188 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:08:37.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990292+0000", 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9330000000000001e-06 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991612+0000", 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319888 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991650+0000", 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8581999999999998e-05 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991668+0000", 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8051999999999999e-05 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991865+0000", 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000196403 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991887+0000", 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2492000000000001e-05 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995547+0000", 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036596369999999999 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995693+0000", 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146136 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998906+0000", 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032132800000000002 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005918+0000", 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070119850000000001 2024-09-16T04:08:37.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007080+0000", 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001161673 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007222+0000", 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014195000000000001 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:189 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~376832] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.145529439000001, 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012452869, 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 189 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996570+0000", 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.756e-06 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997415+0000", 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00084544299999999998 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997456+0000", 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0561e-05 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997484+0000", 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8129000000000001e-05 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000795+0000", 2024-09-16T04:08:37.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033113959999999999 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000996+0000", 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020074599999999999 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018127729999999999 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005921+0000", 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003112489 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.008866+0000", 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029447100000000001 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009020+0000", 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015386600000000001 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.246 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:190 3.9s0 3:9410ed93:::smithi20431790-37:head [setxattr _header (56) in=7b] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.144567123, 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012174411, 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 190 2024-09-16T04:08:37.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997531+0000", 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-06 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997540+0000", 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999999e-06 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997567+0000", 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7121e-05 2024-09-16T04:08:37.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997598+0000", 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003915+0000", 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006316627 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.004057+0000", 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141512 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005216+0000", 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011591800000000001 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006552+0000", 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001335955 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009553+0000", 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030017009999999998 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009704+0000", 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015053199999999999 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.252 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:191 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.144448922, 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015318632, 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 191 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997649+0000", 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.533e-06 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997657+0000", 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-06 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997681+0000", 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3952e-05 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997701+0000", 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0378999999999999e-05 2024-09-16T04:08:37.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007640+0000", 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099382580000000002 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007780+0000", 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140369 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010437+0000", 2024-09-16T04:08:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002657459 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010564+0000", 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012679299999999999 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.012966+0000", 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024021590000000001 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:413 3.0s0 3:04de99e5:::smithi20431790-40:head [create,setxattr jmliR (209) in=5b,setxattr eRqQZNtlPRVjcgdjmbSmOsUSjSlU]tSoVjr`^oRN (489) in=40b,setxattr aR (209) in=2b,setxattr QP`igcZgYZ`X]j_`ObrUNcR_gQZW^mQs_T`XhhQp (10033) in=40b,setxattr V[thp]nUrl^Xata^al[oh[d`ddg`p[siljQWZ^\\X (350) in=40b,setxattr Pp[amim]nQkdfb][ca]Rhonh_mr`cpapUabYUfb\\ (9612) in=40b,setxattr jecnmafmfg__r^\\S_sU]bi]kYaplTcttSSX`\\prR (18524) in=40b,setxattr fVRh^qlag^rjpdaqVk`^r]eR`P[XUlr]]agZjWq[ (1998) in=40b,setxattr hgq\\iqsggNPTRPQok (209) in=17b,setxattr frZXQX\\isoq]gmjs`rk]PiQ\\fV[RTNPNYN]YV[mq (842) in=40b,setxattr `U`PSXddYml`lYXX[sSNnPfg`VgWbXsYnftUQ`it (558) in=40b,setxattr h\\bUdlZ]kknhkaaYeTcclaXatghTgbVrhNQblto_ (946) in=40b,setxattr XgcaedbaNamUmoa^d[dhg[arrjeikfUlToSjsbY` (877) in=40b,setxattr QXqRngrniZSrdNdQaffOsm_g_pYQoedrXoNqT[mn (561) in=40b,setxattr ][ifNPWgaZd[^RnfpRhWbfS\\^a]m[\\[ienetlUUZ (173) in=40b,setxattr mnhUacnNajpOrNecmPZT[OUj[XaWmU (209) in=30b,setxattr ZcXlR_O_^fXfTQrt`cZfOgVlmhepod\\^\\`socsW` (16348) in=40b,setxattr rZrXsckW]Y`iWQiRn (209) in=17b,setxattr peUYXiNb_UsOaXnhlX_s_[QTW_SoUaN]Wal`rkao (1997) in=40b,setxattr eNsVcjeRcj\\m]Q[VhYdSqNcmPhhR[UPR^ORSk_Vd (1823) in=40b] snapc c=[c,a,9] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.0741217700000001, 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069071089999999998, 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 413 2024-09-16T04:08:37.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:37.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067978+0000", 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0809999999999998e-06 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068117+0000", 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013882400000000001 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068146+0000", 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9218e-05 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068160+0000", 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068234+0000", 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3287000000000005e-05 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068326+0000", 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2238999999999996e-05 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.069117+0000", 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079102700000000003 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.070488+0000", 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013705430000000001 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.074811+0000", 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043237340000000001 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:37.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.074882+0000", 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0681999999999999e-05 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:37.263 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:37.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:08:37.265 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:37.259+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:37.366 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:37.362+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:37.404 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:37.404 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:37.418 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:08:37.467 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:37.465+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:37.539 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:37.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:08:37.567 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:37.565+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:37.668 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:37.663+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 33/31 ECSubWrite(tid=1, reqid=client.4631.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.935700+0000", 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.738050004000002, 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053906190000000001, 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935700+0000", 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935700+0000", 2024-09-16T04:08:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.935702+0000", 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5430000000000001e-06 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936039+0000", 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033735200000000002 2024-09-16T04:08:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936073+0000", 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3590999999999997e-05 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936095+0000", 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2378000000000002e-05 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936363+0000", 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026768700000000001 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936388+0000", 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5610999999999999e-05 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941001+0000", 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046132580000000003 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941091+0000", 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9198999999999998e-05 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.736820550000001, 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080395369999999994, 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936932+0000", 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0530000000000001e-06 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937019+0000", 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7212000000000005e-05 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937052+0000", 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3331000000000003e-05 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937092+0000", 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9437000000000002e-05 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937324+0000", 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023248400000000001 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937349+0000", 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5398e-05 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944874+0000", 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075243269999999999 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944969+0000", 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5295000000000002e-05 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.731848710000001, 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063272570000000002, 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941903+0000", 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.457e-06 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942075+0000", 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017237900000000001 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942114+0000", 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8433000000000003e-05 2024-09-16T04:08:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942137+0000", 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3442e-05 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944009+0000", 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018714789999999999 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944031+0000", 2024-09-16T04:08:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2912e-05 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948133+0000", 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041011930000000004 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948229+0000", 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5962e-05 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.731403187000002, 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059926320000000003, 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942348+0000", 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2300000000000001e-06 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942388+0000", 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0377000000000003e-05 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942419+0000", 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0957000000000002e-05 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942449+0000", 2024-09-16T04:08:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9578e-05 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945390+0000", 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029405360000000001 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945413+0000", 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3901999999999999e-05 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948238+0000", 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028249 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948339+0000", 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101152 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.697675922999998, 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064471959999999997, 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976076+0000", 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9429999999999999e-06 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976477+0000", 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000400567 2024-09-16T04:08:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976509+0000", 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2762999999999998e-05 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976533+0000", 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3167999999999999e-05 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976778+0000", 2024-09-16T04:08:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245324 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976803+0000", 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4780999999999999e-05 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982391+0000", 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055884929999999999 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982521+0000", 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013015699999999999 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.694152524, 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072774700000000003, 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979599+0000", 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8530000000000001e-06 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979644+0000", 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4736e-05 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979677+0000", 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2681000000000001e-05 2024-09-16T04:08:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979701+0000", 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3754999999999999e-05 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979867+0000", 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166689 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979890+0000", 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3264e-05 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986795+0000", 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069048069999999998 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986875+0000", 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9684999999999993e-05 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.690560140999999, 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076880730000000001, 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983192+0000", 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983586+0000", 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039456700000000002 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983617+0000", 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0574000000000002e-05 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983639+0000", 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2178999999999999e-05 2024-09-16T04:08:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983866+0000", 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227366 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983888+0000", 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1804e-05 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990760+0000", 2024-09-16T04:08:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068715030000000002 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990878+0000", 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011824600000000001 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=16, reqid=client.4631.0:56, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.68880643, 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064676780000000001, 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984946+0000", 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-16T04:08:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984990+0000", 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3776000000000002e-05 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985022+0000", 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2345999999999998e-05 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985043+0000", 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1549999999999999e-05 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985376+0000", 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033260599999999999 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985400+0000", 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4015e-05 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991311+0000", 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059112239999999996 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991411+0000", 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010003199999999999 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds1 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.68712382, 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059755490000000001, 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986628+0000", 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.905e-06 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986905+0000", 2024-09-16T04:08:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027719099999999998 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986953+0000", 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8182e-05 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986976+0000", 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2997999999999999e-05 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987170+0000", 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193217 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987190+0000", 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0588999999999999e-05 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992498+0000", 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053074669999999997 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992602+0000", 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010399999999999999 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.639485409000001, 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062924130000000002, 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034266+0000", 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034464+0000", 2024-09-16T04:08:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000198808 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034506+0000", 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.197e-05 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034540+0000", 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3098000000000001e-05 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034723+0000", 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018367500000000001 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034753+0000", 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9292e-05 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040460+0000", 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057071020000000004 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040557+0000", 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7400999999999998e-05 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.642887232, 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061099889999999997, 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030927+0000", 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3188999999999994e-05 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030971+0000", 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4634e-05 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030995+0000", 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4032e-05 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031211+0000", 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021563299999999999 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031241+0000", 2024-09-16T04:08:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0329e-05 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036878+0000", 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056365449999999997 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036973+0000", 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5047e-05 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=216, reqid=client.4631.0:301, at_version=0'0, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.617968399, 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059219310000000001, 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055784+0000", 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9929999999999998e-06 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055815+0000", 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055858+0000", 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3096999999999998e-05 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055879+0000", 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1688999999999999e-05 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056067+0000", 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018760099999999999 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056101+0000", 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3775000000000001e-05 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061623+0000", 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055219730000000003 2024-09-16T04:08:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061704+0000", 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0897999999999997e-05 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.820725726, 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058830389999999996, 2024-09-16T04:08:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853026+0000", 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0899999999999999e-06 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853087+0000", 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0560000000000003e-05 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853119+0000", 2024-09-16T04:08:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2104999999999998e-05 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853144+0000", 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4912000000000001e-05 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855175+0000", 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002031007 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855211+0000", 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5680999999999999e-05 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858817+0000", 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036060860000000001 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858907+0000", 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0598000000000002e-05 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.8205469519999999, 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098485320000000001, 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853204+0000", 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0300000000000001e-06 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853263+0000", 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9006999999999999e-05 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853290+0000", 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6520999999999999e-05 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853309+0000", 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9826e-05 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857423+0000", 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041136109999999997 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1618000000000001e-05 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862892+0000", 2024-09-16T04:08:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005437491 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863052+0000", 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015942800000000001 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853360+0000", 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.8203900280000003, 2024-09-16T04:08:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056368060000000003, 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853360+0000", 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853360+0000", 2024-09-16T04:08:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853361+0000", 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9699999999999994e-07 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853411+0000", 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0027000000000001e-05 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853438+0000", 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853457+0000", 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9491999999999999e-05 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.856113+0000", 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026554590000000002 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.856138+0000", 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5439000000000002e-05 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858918+0000", 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002780228 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858997+0000", 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8625e-05 2024-09-16T04:08:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.8202607049999999, 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069765720000000003, 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853490+0000", 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3699999999999999e-07 2024-09-16T04:08:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853601+0000", 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111047 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853629+0000", 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7568000000000001e-05 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853648+0000", 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9199e-05 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857263+0000", 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036145560000000001 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857285+0000", 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2382e-05 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860374+0000", 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030894009999999999 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860466+0000", 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1582000000000005e-05 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.8179154520000003, 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072392969999999996, 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855836+0000", 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3699999999999999e-07 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855889+0000", 2024-09-16T04:08:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.346e-05 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855913+0000", 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3635e-05 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855930+0000", 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7499e-05 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857410+0000", 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001480121 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857433+0000", 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2582000000000002e-05 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862976+0000", 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055433549999999998 2024-09-16T04:08:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863074+0000", 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7707999999999994e-05 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 54/31 ECSubWrite(tid=254, reqid=osd.11.0:254, at_version=54'19, trim_to=0'0, roll_forward_to=52'17))", 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.60538539899999999, 2024-09-16T04:08:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078273349999999995, 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6000000000000003e-07 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068423+0000", 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7707000000000002e-05 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068454+0000", 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0882e-05 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068478+0000", 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4362000000000002e-05 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068698+0000", 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021970299999999999 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068725+0000", 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7279000000000001e-05 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076089+0000", 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0073640800000000003 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076192+0000", 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102662 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.605180516, 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076635829999999999, 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068571+0000", 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1599999999999999e-06 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068645+0000", 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4610999999999994e-05 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068672+0000", 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6710999999999999e-05 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068692+0000", 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0373e-05 2024-09-16T04:08:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068869+0000", 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017663499999999999 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068896+0000", 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7231999999999999e-05 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076166+0000", 2024-09-16T04:08:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007269948 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076233+0000", 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6913000000000001e-05 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.60245762599999997, 2024-09-16T04:08:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074803539999999998, 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071293+0000", 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1699999999999998e-07 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071345+0000", 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1811000000000003e-05 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071377+0000", 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2061999999999999e-05 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071404+0000", 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7072000000000001e-05 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071568+0000", 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163609 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071626+0000", 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8811000000000003e-05 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078616+0000", 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069891459999999999 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078773+0000", 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157226 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:37.776 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:37.776 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:37.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:08:37.778 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:37.772+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:37.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-16T04:08:37.878 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:37.876+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:37.934 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:37.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:37.954 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:37.955 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:37.955 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:37.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:08:37.976 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:38.001 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:38.001 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:38.010 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:38.008+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:38.018 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:38.036 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:38.036 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:38.057 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:38.058 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:38.066 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.14 to 1 (10000) 2024-09-16T04:08:38.070 INFO:tasks.rados.rados.0.smithi204.stdout:160: done (5 left) 2024-09-16T04:08:38.070 INFO:tasks.rados.rados.0.smithi204.stdout:161: done (4 left) 2024-09-16T04:08:38.070 INFO:tasks.rados.rados.0.smithi204.stdout:162: done (3 left) 2024-09-16T04:08:38.070 INFO:tasks.rados.rados.0.smithi204.stdout:163: done (2 left) 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:164: done (1 left) 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:166: done (0 left) 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:167: read oid 46 snap -1 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:167: expect (ObjNum 59 snap 4 seq_num 59) 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:168: rmattr oid 37 current snap is 12 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:168: done (1 left) 2024-09-16T04:08:38.071 INFO:tasks.rados.rados.0.smithi204.stdout:169: snap_create 2024-09-16T04:08:38.081 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:38.075+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:38.085 INFO:tasks.rados.rados.0.smithi204.stdout:167: expect (ObjNum 59 snap 4 seq_num 59) 2024-09-16T04:08:38.086 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:38.086 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:38.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-16T04:08:38.106 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:38.106 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:38.126 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:38.127 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:38.141 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:38.142 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:38.148 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:38.148 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:38.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:08:38.169 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:38.188 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:38.188 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:38.202 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:38.200+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:38.207 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:38.207 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:38.232 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:38.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:38.233+0000 7fac4dfd6640 0 -- 172.21.15.32:0/2508195828 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7fac482265c0 msgr2=0x7fac482289b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:38.253 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:38.253 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:38.284 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:38.284 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:38.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:08:38.314 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:38.313+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:38.390 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:38.388+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:38.477 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:38.478 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:38.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:38.478+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:38.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:08:38.586 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:38.583+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:38.661 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:38.661 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:38.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:08:38.687 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:38.685+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:38.787 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:38.783+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:38.795 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:38.796 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:38.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:08:38.888 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:38.885+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:38.929 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:38.929 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:38.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:08:38.990 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:38.988+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:39.077 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-16T04:08:39.077 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.15 to 1 (10000) 2024-09-16T04:08:39.078 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:39.078 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:39.078 INFO:tasks.rados.rados.0.smithi204.stdout:167: done (1 left) 2024-09-16T04:08:39.078 INFO:tasks.rados.rados.0.smithi204.stdout:169: done (0 left) 2024-09-16T04:08:39.078 INFO:tasks.rados.rados.0.smithi204.stdout:170: read oid 36 snap 10 2024-09-16T04:08:39.078 INFO:tasks.rados.rados.0.smithi204.stdout:170: expect (ObjNum 60 snap 4 seq_num 60) 2024-09-16T04:08:39.079 INFO:tasks.rados.rados.0.smithi204.stdout:171: setattr oid 14 current snap is 13 2024-09-16T04:08:39.081 INFO:tasks.rados.rados.0.smithi204.stdout:172: setattr oid 5 current snap is 13 2024-09-16T04:08:39.086 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 30 current snap is 13 2024-09-16T04:08:39.086 INFO:tasks.rados.rados.0.smithi204.stdout:173: seq_num 90 ranges {2605056=753664,3358720=720896,4079616=49152} 2024-09-16T04:08:39.090 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:39.089+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:39.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:08:39.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T04:08:39.108 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:39.129 INFO:tasks.rados.rados.0.smithi204.stdout:173: writing smithi20431790-30 from 2605056 to 3358720 tid 1 2024-09-16T04:08:39.138 INFO:tasks.rados.rados.0.smithi204.stdout:173: writing smithi20431790-30 from 3358720 to 4079616 tid 2 2024-09-16T04:08:39.139 INFO:tasks.rados.rados.0.smithi204.stdout:173: writing smithi20431790-30 from 4079616 to 4128768 tid 3 2024-09-16T04:08:39.139 INFO:tasks.rados.rados.0.smithi204.stdout:174: snap_remove snap 12 2024-09-16T04:08:39.192 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:39.187+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:39.269 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:39.269 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:39.285 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:08:39.292 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:39.288+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:39.393 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:39.389+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:39.414 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:39.414 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:39.428 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:08:39.477 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:39.478 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:39.494 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:39.490+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:39.495 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-16T04:08:39.073293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51544627,"num_objects":70,"num_object_clones":19,"num_object_copies":470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":1,"num_read":351,"num_read_kb":30520,"num_write":528,"num_write_kb":59030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":535,"ondisk_log_size":535,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":553688,"kb_used_data":96244,"kb_used_omap":24,"kb_used_meta":457063,"kb_avail":1509395752,"statfs":{"total":1546188226560,"available":1545621250048,"internally_reserved":0,"allocated":98553856,"data_stored":106736636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":468032591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1441792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7347,"num_write":3,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.237744"},"pg_stats":[{"pgid":"3.f","version":"48'21","reported_seq":127,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.868002+0000","last_change":"2024-09-16T04:08:30.876469+0000","last_active":"2024-09-16T04:08:33.868002+0000","last_peered":"2024-09-16T04:08:33.868002+0000","last_clean":"2024-09-16T04:08:33.868002+0000","last_became_active":"2024-09-16T04:08:14.947752+0000","last_became_peered":"2024-09-16T04:08:14.947752+0000","last_unstale":"2024-09-16T04:08:33.868002+0000","last_undegraded":"2024-09-16T04:08:33.868002+0000","last_fullsized":"2024-09-16T04:08:33.868002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:42.080184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027369952999999999,"stat_sum":{"num_bytes":2457600,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":2311,"num_write":12,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,4,11,7,10,2],"acting":[13,12,4,11,7,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"3.e","version":"52'19","reported_seq":128,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.868565+0000","last_change":"2024-09-16T04:08:34.870253+0000","last_active":"2024-09-16T04:08:34.868565+0000","last_peered":"2024-09-16T04:08:34.868565+0000","last_clean":"2024-09-16T04:08:34.868565+0000","last_became_active":"2024-09-16T04:08:15.495259+0000","last_became_peered":"2024-09-16T04:08:15.495259+0000","last_unstale":"2024-09-16T04:08:34.868565+0000","last_undegraded":"2024-09-16T04:08:34.868565+0000","last_fullsized":"2024-09-16T04:08:34.868565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:41.056093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015354741999999999,"stat_sum":{"num_bytes":4456448,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":5334,"num_write":13,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,4,13,2,0,15],"acting":[8,11,4,13,2,0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"3.d","version":"34'2","reported_seq":98,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.867331+0000","last_change":"2024-09-16T04:08:30.867180+0000","last_active":"2024-09-16T04:08:33.867331+0000","last_peered":"2024-09-16T04:08:33.867331+0000","last_clean":"2024-09-16T04:08:33.867331+0000","last_became_active":"2024-09-16T04:08:15.857514+0000","last_became_peered":"2024-09-16T04:08:15.857514+0000","last_unstale":"2024-09-16T04:08:33.867331+0000","last_undegraded":"2024-09-16T04:08:33.867331+0000","last_fullsized":"2024-09-16T04:08:33.867331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:19.758718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017898027,"stat_sum":{"num_bytes":376832,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,0,12,9,2,6],"acting":[13,1,0,12,9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"3.c","version":"51'15","reported_seq":114,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.000016+0000","last_change":"2024-09-16T04:08:30.870963+0000","last_active":"2024-09-16T04:08:34.000016+0000","last_peered":"2024-09-16T04:08:34.000016+0000","last_clean":"2024-09-16T04:08:34.000016+0000","last_became_active":"2024-09-16T04:08:14.948022+0000","last_became_peered":"2024-09-16T04:08:14.948022+0000","last_unstale":"2024-09-16T04:08:34.000016+0000","last_undegraded":"2024-09-16T04:08:34.000016+0000","last_fullsized":"2024-09-16T04:08:34.000016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:24.380930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021705413999999999,"stat_sum":{"num_bytes":4390912,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":1157,"num_write":11,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,13,12,4,2,6],"acting":[5,10,13,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"3.b","version":"51'70","reported_seq":179,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.880927+0000","last_change":"2024-09-16T04:08:30.884707+0000","last_active":"2024-09-16T04:08:33.880927+0000","last_peered":"2024-09-16T04:08:33.880927+0000","last_clean":"2024-09-16T04:08:33.880927+0000","last_became_active":"2024-09-16T04:08:15.856491+0000","last_became_peered":"2024-09-16T04:08:15.856491+0000","last_unstale":"2024-09-16T04:08:33.880927+0000","last_undegraded":"2024-09-16T04:08:33.880927+0000","last_fullsized":"2024-09-16T04:08:33.880927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.523687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034749215,"stat_sum":{"num_bytes":8798208,"num_objects":11,"num_object_clones":4,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":34,"num_read_kb":2415,"num_write":60,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,11,15,8,1,14],"acting":[10,6,11,15,8,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"3.a","version":"48'30","reported_seq":130,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.866679+0000","last_change":"2024-09-16T04:08:30.866099+0000","last_active":"2024-09-16T04:08:33.866679+0000","last_peered":"2024-09-16T04:08:33.866679+0000","last_clean":"2024-09-16T04:08:33.866679+0000","last_became_active":"2024-09-16T04:08:15.858613+0000","last_became_peered":"2024-09-16T04:08:15.858613+0000","last_unstale":"2024-09-16T04:08:33.866679+0000","last_undegraded":"2024-09-16T04:08:33.866679+0000","last_fullsized":"2024-09-16T04:08:33.866679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.361916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017203764999999999,"stat_sum":{"num_bytes":2883584,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":149,"num_write":16,"num_write_kb":3184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,8,9,0],"acting":[13,1,7,5,8,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"3.9","version":"52'23","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.859174+0000","last_change":"2024-09-16T04:08:34.860779+0000","last_active":"2024-09-16T04:08:34.859174+0000","last_peered":"2024-09-16T04:08:34.859174+0000","last_clean":"2024-09-16T04:08:34.859174+0000","last_became_active":"2024-09-16T04:08:14.936519+0000","last_became_peered":"2024-09-16T04:08:14.936519+0000","last_unstale":"2024-09-16T04:08:34.859174+0000","last_undegraded":"2024-09-16T04:08:34.859174+0000","last_fullsized":"2024-09-16T04:08:34.859174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:24.852976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022658991999999999,"stat_sum":{"num_bytes":1572864,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,14,4,5,10,6],"acting":[12,11,14,4,5,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"3.8","version":"48'15","reported_seq":113,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.865955+0000","last_change":"2024-09-16T04:08:30.872406+0000","last_active":"2024-09-16T04:08:33.865955+0000","last_peered":"2024-09-16T04:08:33.865955+0000","last_clean":"2024-09-16T04:08:33.865955+0000","last_became_active":"2024-09-16T04:08:15.855574+0000","last_became_peered":"2024-09-16T04:08:15.855574+0000","last_unstale":"2024-09-16T04:08:33.865955+0000","last_undegraded":"2024-09-16T04:08:33.865955+0000","last_fullsized":"2024-09-16T04:08:33.865955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:23.616999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024675124,"stat_sum":{"num_bytes":1703936,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":436,"num_write":9,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,0,15,14,1,4],"acting":[11,10,0,15,14,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"1.0","version":"27'157","reported_seq":257,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.865968+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:33.865968+0000","last_peered":"2024-09-16T04:08:33.865968+0000","last_clean":"2024-09-16T04:08:33.865968+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:33.865968+0000","last_undegraded":"2024-09-16T04:08:33.865968+0000","last_fullsized":"2024-09-16T04:08:33.865968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.866532+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:33.866532+0000","last_peered":"2024-09-16T04:08:33.866532+0000","last_clean":"2024-09-16T04:08:33.866532+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:33.866532+0000","last_undegraded":"2024-09-16T04:08:33.866532+0000","last_fullsized":"2024-09-16T04:08:33.866532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"48'42","reported_seq":139,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.867235+0000","last_change":"2024-09-16T04:08:30.885329+0000","last_active":"2024-09-16T04:08:33.867235+0000","last_peered":"2024-09-16T04:08:33.867235+0000","last_clean":"2024-09-16T04:08:33.867235+0000","last_became_active":"2024-09-16T04:08:15.856679+0000","last_became_peered":"2024-09-16T04:08:15.856679+0000","last_unstale":"2024-09-16T04:08:33.867235+0000","last_undegraded":"2024-09-16T04:08:33.867235+0000","last_fullsized":"2024-09-16T04:08:33.867235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:38.276098+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.037553956999999999,"stat_sum":{"num_bytes":5144576,"num_objects":8,"num_object_clones":3,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":15,"num_read_kb":9,"num_write":29,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,13,1,5,3,7],"acting":[11,12,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.868450+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:33.868450+0000","last_peered":"2024-09-16T04:08:33.868450+0000","last_clean":"2024-09-16T04:08:33.868450+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:33.868450+0000","last_undegraded":"2024-09-16T04:08:33.868450+0000","last_fullsized":"2024-09-16T04:08:33.868450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"42'10","reported_seq":113,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.846825+0000","last_change":"2024-09-16T04:08:34.847598+0000","last_active":"2024-09-16T04:08:34.846825+0000","last_peered":"2024-09-16T04:08:34.846825+0000","last_clean":"2024-09-16T04:08:34.846825+0000","last_became_active":"2024-09-16T04:08:15.495747+0000","last_became_peered":"2024-09-16T04:08:15.495747+0000","last_unstale":"2024-09-16T04:08:34.846825+0000","last_undegraded":"2024-09-16T04:08:34.846825+0000","last_fullsized":"2024-09-16T04:08:34.846825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:39.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012693540000000001,"stat_sum":{"num_bytes":2031616,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":7,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13,3,11,12,0,7],"acting":[6,13,3,11,12,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.854118+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:34.854118+0000","last_peered":"2024-09-16T04:08:34.854118+0000","last_clean":"2024-09-16T04:08:34.854118+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:34.854118+0000","last_undegraded":"2024-09-16T04:08:34.854118+0000","last_fullsized":"2024-09-16T04:08:34.854118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"52'25","reported_seq":132,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.859180+0000","last_change":"2024-09-16T04:08:34.861344+0000","last_active":"2024-09-16T04:08:34.859180+0000","last_peered":"2024-09-16T04:08:34.859180+0000","last_clean":"2024-09-16T04:08:34.859180+0000","last_became_active":"2024-09-16T04:08:15.466434+0000","last_became_peered":"2024-09-16T04:08:15.466434+0000","last_unstale":"2024-09-16T04:08:34.859180+0000","last_undegraded":"2024-09-16T04:08:34.859180+0000","last_fullsized":"2024-09-16T04:08:34.859180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:22.942299+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.022807241999999998,"stat_sum":{"num_bytes":4276224,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":1974,"num_write":13,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,5,9,3,13,11,6],"acting":[12,5,9,3,13,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.2","version":"27'2","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.867039+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:33.867039+0000","last_peered":"2024-09-16T04:08:33.867039+0000","last_clean":"2024-09-16T04:08:33.867039+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:33.867039+0000","last_undegraded":"2024-09-16T04:08:33.867039+0000","last_fullsized":"2024-09-16T04:08:33.867039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"44'27","reported_seq":138,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.854772+0000","last_change":"2024-09-16T04:08:34.855244+0000","last_active":"2024-09-16T04:08:34.854772+0000","last_peered":"2024-09-16T04:08:34.854772+0000","last_clean":"2024-09-16T04:08:34.854772+0000","last_became_active":"2024-09-16T04:08:14.946050+0000","last_became_peered":"2024-09-16T04:08:14.946050+0000","last_unstale":"2024-09-16T04:08:34.854772+0000","last_undegraded":"2024-09-16T04:08:34.854772+0000","last_fullsized":"2024-09-16T04:08:34.854772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.524085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074286000000000003,"stat_sum":{"num_bytes":3260416,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":6201,"num_write":18,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,2,13,4,6,5],"acting":[15,9,2,13,4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"3.5","version":"48'12","reported_seq":128,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.855289+0000","last_change":"2024-09-16T04:08:30.851309+0000","last_active":"2024-09-16T04:08:33.855289+0000","last_peered":"2024-09-16T04:08:33.855289+0000","last_clean":"2024-09-16T04:08:33.855289+0000","last_became_active":"2024-09-16T04:08:14.934767+0000","last_became_peered":"2024-09-16T04:08:14.934767+0000","last_unstale":"2024-09-16T04:08:33.855289+0000","last_undegraded":"2024-09-16T04:08:33.855289+0000","last_fullsized":"2024-09-16T04:08:33.855289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.095776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013726840000000001,"stat_sum":{"num_bytes":2146304,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":33,"num_read_kb":8524,"num_write":30,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,14,9,10,13,8],"acting":[5,6,14,9,10,13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.845651+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:34.845651+0000","last_peered":"2024-09-16T04:08:34.845651+0000","last_clean":"2024-09-16T04:08:34.845651+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:34.845651+0000","last_undegraded":"2024-09-16T04:08:34.845651+0000","last_fullsized":"2024-09-16T04:08:34.845651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"51'49","reported_seq":146,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.862566+0000","last_change":"2024-09-16T04:08:30.885509+0000","last_active":"2024-09-16T04:08:33.862566+0000","last_peered":"2024-09-16T04:08:33.862566+0000","last_clean":"2024-09-16T04:08:33.862566+0000","last_became_active":"2024-09-16T04:08:15.495248+0000","last_became_peered":"2024-09-16T04:08:15.495248+0000","last_unstale":"2024-09-16T04:08:33.862566+0000","last_undegraded":"2024-09-16T04:08:33.862566+0000","last_fullsized":"2024-09-16T04:08:33.862566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:30.385764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035527665999999999,"stat_sum":{"num_bytes":5701632,"num_objects":9,"num_object_clones":3,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":9,"num_write":85,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,3,15,6,0],"acting":[10,12,14,3,15,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"5","length":"1"},{"start":"7","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.854108+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:34.854108+0000","last_peered":"2024-09-16T04:08:34.854108+0000","last_clean":"2024-09-16T04:08:34.854108+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:34.854108+0000","last_undegraded":"2024-09-16T04:08:34.854108+0000","last_fullsized":"2024-09-16T04:08:34.854108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":105,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.841417+0000","last_change":"2024-09-16T04:08:34.842225+0000","last_active":"2024-09-16T04:08:34.841417+0000","last_peered":"2024-09-16T04:08:34.841417+0000","last_clean":"2024-09-16T04:08:34.841417+0000","last_became_active":"2024-09-16T04:08:14.939313+0000","last_became_peered":"2024-09-16T04:08:14.939313+0000","last_unstale":"2024-09-16T04:08:34.841417+0000","last_undegraded":"2024-09-16T04:08:34.841417+0000","last_fullsized":"2024-09-16T04:08:34.841417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:34.461123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001339235,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1874,"num_write":2,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,7,4,11,6,13],"acting":[14,8,7,4,11,6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.840047+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:34.840047+0000","last_peered":"2024-09-16T04:08:34.840047+0000","last_clean":"2024-09-16T04:08:34.840047+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:34.840047+0000","last_undegraded":"2024-09-16T04:08:34.840047+0000","last_fullsized":"2024-09-16T04:08:34.840047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"42'13","reported_seq":112,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.841239+0000","last_change":"2024-09-16T04:08:34.841973+0000","last_active":"2024-09-16T04:08:34.841239+0000","last_peered":"2024-09-16T04:08:34.841239+0000","last_clean":"2024-09-16T04:08:34.841239+0000","last_became_active":"2024-09-16T04:08:15.494877+0000","last_became_peered":"2024-09-16T04:08:15.494877+0000","last_unstale":"2024-09-16T04:08:34.841239+0000","last_undegraded":"2024-09-16T04:08:34.841239+0000","last_fullsized":"2024-09-16T04:08:34.841239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:38.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015310949999999999,"stat_sum":{"num_bytes":1114112,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":6,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7,15,5,11,9,0],"acting":[14,7,15,5,11,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T04:08:33.867851+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:33.867851+0000","last_peered":"2024-09-16T04:08:33.867851+0000","last_clean":"2024-09-16T04:08:33.867851+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:33.867851+0000","last_undegraded":"2024-09-16T04:08:33.867851+0000","last_fullsized":"2024-09-16T04:08:33.867851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":50954240,"num_objects":66,"num_object_clones":19,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":1,"num_read":215,"num_read_kb":30402,"num_write":323,"num_write_kb":55568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87703552,"data_stored":99586048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":375,"ondisk_log_size":375,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247817,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33804,"kb_used_data":6776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338036,"statfs":{"total":96636764160,"available":96602148864,"internally_reserved":0,"allocated":6938624,"data_stored":7656433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":5636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":5771264,"data_stored":5891057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247818,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37932,"kb_used_data":6744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333908,"statfs":{"total":96636764160,"available":96597921792,"internally_reserved":0,"allocated":6905856,"data_stored":7013361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313227,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":4704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":4816896,"data_stored":4883747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280522,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":5136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":5259264,"data_stored":6087359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280522,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37892,"kb_used_data":6700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333948,"statfs":{"total":96636764160,"available":96597962752,"internally_reserved":0,"allocated":6860800,"data_stored":7908120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280523,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31144,"kb_used_data":4116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340696,"statfs":{"total":96636764160,"available":96604872704,"internally_reserved":0,"allocated":4214784,"data_stored":4690623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280523,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31112,"kb_used_data":4080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340728,"statfs":{"total":96636764160,"available":96604905472,"internally_reserved":0,"allocated":4177920,"data_stored":4127512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33780,"kb_used_data":6744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338060,"statfs":{"total":96636764160,"available":96602173440,"internally_reserved":0,"allocated":6905856,"data_stored":8071979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280523,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36056,"kb_used_data":9028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335784,"statfs":{"total":96636764160,"available":96599842816,"internally_reserved":0,"allocated":9244672,"data_stored":11001144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280522,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34700,"kb_used_data":7668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337140,"statfs":{"total":96636764160,"available":96601231360,"internally_reserved":0,"allocated":7852032,"data_stored":8676050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247817,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36632,"kb_used_data":5440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335208,"statfs":{"total":96636764160,"available":96599252992,"internally_reserved":0,"allocated":5570560,"data_stored":5592593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247819,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":4596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":4706304,"data_stored":4391921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247817,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":5160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":5283840,"data_stored":6060824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247818,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39636,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332204,"statfs":{"total":96636764160,"available":96596176896,"internally_reserved":0,"allocated":8650752,"data_stored":8729585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247817,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":5268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":5394432,"data_stored":5954328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4358144,"data_stored":4698112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4726784,"data_stored":5857280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":4497408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4026368,"data_stored":4026368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":5382144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6197248,"data_stored":7553024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7970816,"data_stored":8364032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4345856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4911104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":3514368,"data_stored":3772416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":6692864,"data_stored":8171520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8048640,"data_stored":10117120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6647808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":9445376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":5091328,"data_stored":5525504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":5931008,"data_stored":6270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:39.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:39.551 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:39.551 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:39.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:08:39.595 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:39.591+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:39.695 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:39.691+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:39.735 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:39.735 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:39.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:08:39.796 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:39.790+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:39.843 INFO:tasks.rados.rados.0.smithi204.stdout:174: done (4 left) 2024-09-16T04:08:39.843 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 44 current snap is 13 2024-09-16T04:08:39.843 INFO:tasks.rados.rados.0.smithi204.stdout:175: seq_num 91 ranges {1818624=770048,2588672=475136,3063808=294912} 2024-09-16T04:08:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:39.851 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:39.868 INFO:tasks.rados.rados.0.smithi204.stdout:175: writing smithi20431790-44 from 1818624 to 2588672 tid 1 2024-09-16T04:08:39.869 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-16T04:08:39.835561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":57197107,"num_objects":61,"num_object_clones":11,"num_object_copies":407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":368,"num_read_kb":43776,"num_write":588,"num_write_kb":66310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":616,"ondisk_log_size":616,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":558764,"kb_used_data":101328,"kb_used_omap":24,"kb_used_meta":457063,"kb_avail":1509390676,"statfs":{"total":1546188226560,"available":1545616052224,"internally_reserved":0,"allocated":103759872,"data_stored":109065779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":468032591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5652480,"num_objects":-9,"num_object_clones":-8,"num_object_copies":-63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9,"num_whiteouts":-1,"num_read":17,"num_read_kb":13256,"num_write":60,"num_write_kb":7280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.998775"},"pg_stats":[{"pgid":"3.f","version":"54'27","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.089771+0000","last_change":"2024-09-16T04:08:37.084471+0000","last_active":"2024-09-16T04:08:39.089771+0000","last_peered":"2024-09-16T04:08:39.089771+0000","last_clean":"2024-09-16T04:08:39.089771+0000","last_became_active":"2024-09-16T04:08:14.947752+0000","last_became_peered":"2024-09-16T04:08:14.947752+0000","last_unstale":"2024-09-16T04:08:39.089771+0000","last_undegraded":"2024-09-16T04:08:39.089771+0000","last_fullsized":"2024-09-16T04:08:39.089771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:15.449334+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.015572193,"stat_sum":{"num_bytes":2457600,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":2311,"num_write":12,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,4,11,7,10,2],"acting":[13,12,4,11,7,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.e","version":"52'19","reported_seq":128,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.868565+0000","last_change":"2024-09-16T04:08:34.870253+0000","last_active":"2024-09-16T04:08:34.868565+0000","last_peered":"2024-09-16T04:08:34.868565+0000","last_clean":"2024-09-16T04:08:34.868565+0000","last_became_active":"2024-09-16T04:08:15.495259+0000","last_became_peered":"2024-09-16T04:08:15.495259+0000","last_unstale":"2024-09-16T04:08:34.868565+0000","last_undegraded":"2024-09-16T04:08:34.868565+0000","last_fullsized":"2024-09-16T04:08:34.868565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:41.056093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015354741999999999,"stat_sum":{"num_bytes":4456448,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":5334,"num_write":13,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,4,13,2,0,15],"acting":[8,11,4,13,2,0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"3.d","version":"54'9","reported_seq":132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.089344+0000","last_change":"2024-09-16T04:08:37.091618+0000","last_active":"2024-09-16T04:08:39.089344+0000","last_peered":"2024-09-16T04:08:39.089344+0000","last_clean":"2024-09-16T04:08:39.089344+0000","last_became_active":"2024-09-16T04:08:15.857514+0000","last_became_peered":"2024-09-16T04:08:15.857514+0000","last_unstale":"2024-09-16T04:08:39.089344+0000","last_undegraded":"2024-09-16T04:08:39.089344+0000","last_fullsized":"2024-09-16T04:08:39.089344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:19.967258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.02228072,"stat_sum":{"num_bytes":1851392,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":6,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,0,12,9,2,6],"acting":[13,1,0,12,9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.c","version":"54'21","reported_seq":147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.183615+0000","last_change":"2024-09-16T04:08:37.090812+0000","last_active":"2024-09-16T04:08:39.183615+0000","last_peered":"2024-09-16T04:08:39.183615+0000","last_clean":"2024-09-16T04:08:39.183615+0000","last_became_active":"2024-09-16T04:08:14.948022+0000","last_became_peered":"2024-09-16T04:08:14.948022+0000","last_unstale":"2024-09-16T04:08:39.183615+0000","last_undegraded":"2024-09-16T04:08:39.183615+0000","last_fullsized":"2024-09-16T04:08:39.183615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.241308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024321288,"stat_sum":{"num_bytes":4390912,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":1157,"num_write":11,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,13,12,4,2,6],"acting":[5,10,13,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.b","version":"56'96","reported_seq":231,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.154289+0000","last_change":"2024-09-16T04:08:37.089766+0000","last_active":"2024-09-16T04:08:39.154289+0000","last_peered":"2024-09-16T04:08:39.154289+0000","last_clean":"2024-09-16T04:08:39.154289+0000","last_became_active":"2024-09-16T04:08:15.856491+0000","last_became_peered":"2024-09-16T04:08:15.856491+0000","last_unstale":"2024-09-16T04:08:39.154289+0000","last_undegraded":"2024-09-16T04:08:39.154289+0000","last_fullsized":"2024-09-16T04:08:39.154289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:42.620202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023960274,"stat_sum":{"num_bytes":11337728,"num_objects":12,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":40,"num_read_kb":11346,"num_write":108,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,11,15,8,1,14],"acting":[10,6,11,15,8,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.a","version":"52'32","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.089034+0000","last_change":"2024-09-16T04:08:37.071941+0000","last_active":"2024-09-16T04:08:39.089034+0000","last_peered":"2024-09-16T04:08:39.089034+0000","last_clean":"2024-09-16T04:08:39.089034+0000","last_became_active":"2024-09-16T04:08:15.858613+0000","last_became_peered":"2024-09-16T04:08:15.858613+0000","last_unstale":"2024-09-16T04:08:39.089034+0000","last_undegraded":"2024-09-16T04:08:39.089034+0000","last_fullsized":"2024-09-16T04:08:39.089034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:25.482986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037189829999999999,"stat_sum":{"num_bytes":2883584,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":149,"num_write":16,"num_write_kb":3184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,8,9,0],"acting":[13,1,7,5,8,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"3.9","version":"52'23","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.859174+0000","last_change":"2024-09-16T04:08:34.860779+0000","last_active":"2024-09-16T04:08:34.859174+0000","last_peered":"2024-09-16T04:08:34.859174+0000","last_clean":"2024-09-16T04:08:34.859174+0000","last_became_active":"2024-09-16T04:08:14.936519+0000","last_became_peered":"2024-09-16T04:08:14.936519+0000","last_unstale":"2024-09-16T04:08:34.859174+0000","last_undegraded":"2024-09-16T04:08:34.859174+0000","last_fullsized":"2024-09-16T04:08:34.859174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:24.852976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022658991999999999,"stat_sum":{"num_bytes":1572864,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,14,4,5,10,6],"acting":[12,11,14,4,5,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"3.8","version":"54'19","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.076729+0000","last_change":"2024-09-16T04:08:37.081787+0000","last_active":"2024-09-16T04:08:39.076729+0000","last_peered":"2024-09-16T04:08:39.076729+0000","last_clean":"2024-09-16T04:08:39.076729+0000","last_became_active":"2024-09-16T04:08:15.855574+0000","last_became_peered":"2024-09-16T04:08:15.855574+0000","last_unstale":"2024-09-16T04:08:39.076729+0000","last_undegraded":"2024-09-16T04:08:39.076729+0000","last_fullsized":"2024-09-16T04:08:39.076729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.683954+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.017796385000000001,"stat_sum":{"num_bytes":1703936,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":436,"num_write":9,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,0,15,14,1,4],"acting":[11,10,0,15,14,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"1.0","version":"27'157","reported_seq":267,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.076737+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:39.076737+0000","last_peered":"2024-09-16T04:08:39.076737+0000","last_clean":"2024-09-16T04:08:39.076737+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:39.076737+0000","last_undegraded":"2024-09-16T04:08:39.076737+0000","last_fullsized":"2024-09-16T04:08:39.076737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.076151+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:39.076151+0000","last_peered":"2024-09-16T04:08:39.076151+0000","last_clean":"2024-09-16T04:08:39.076151+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:39.076151+0000","last_undegraded":"2024-09-16T04:08:39.076151+0000","last_fullsized":"2024-09-16T04:08:39.076151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"54'55","reported_seq":184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.076246+0000","last_change":"2024-09-16T04:08:37.084436+0000","last_active":"2024-09-16T04:08:39.076246+0000","last_peered":"2024-09-16T04:08:39.076246+0000","last_clean":"2024-09-16T04:08:39.076246+0000","last_became_active":"2024-09-16T04:08:15.856679+0000","last_became_peered":"2024-09-16T04:08:15.856679+0000","last_unstale":"2024-09-16T04:08:39.076246+0000","last_undegraded":"2024-09-16T04:08:39.076246+0000","last_fullsized":"2024-09-16T04:08:39.076246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:25.041670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019719727999999999,"stat_sum":{"num_bytes":6389760,"num_objects":6,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":4332,"num_write":33,"num_write_kb":7632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,13,1,5,3,7],"acting":[11,12,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.337921+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:39.337921+0000","last_peered":"2024-09-16T04:08:39.337921+0000","last_clean":"2024-09-16T04:08:39.337921+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:39.337921+0000","last_undegraded":"2024-09-16T04:08:39.337921+0000","last_fullsized":"2024-09-16T04:08:39.337921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"42'10","reported_seq":113,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.846825+0000","last_change":"2024-09-16T04:08:34.847598+0000","last_active":"2024-09-16T04:08:34.846825+0000","last_peered":"2024-09-16T04:08:34.846825+0000","last_clean":"2024-09-16T04:08:34.846825+0000","last_became_active":"2024-09-16T04:08:15.495747+0000","last_became_peered":"2024-09-16T04:08:15.495747+0000","last_unstale":"2024-09-16T04:08:34.846825+0000","last_undegraded":"2024-09-16T04:08:34.846825+0000","last_fullsized":"2024-09-16T04:08:34.846825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:39.114105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012693540000000001,"stat_sum":{"num_bytes":2031616,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":7,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13,3,11,12,0,7],"acting":[6,13,3,11,12,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.854118+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:34.854118+0000","last_peered":"2024-09-16T04:08:34.854118+0000","last_clean":"2024-09-16T04:08:34.854118+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:34.854118+0000","last_undegraded":"2024-09-16T04:08:34.854118+0000","last_fullsized":"2024-09-16T04:08:34.854118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"52'25","reported_seq":132,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.859180+0000","last_change":"2024-09-16T04:08:34.861344+0000","last_active":"2024-09-16T04:08:34.859180+0000","last_peered":"2024-09-16T04:08:34.859180+0000","last_clean":"2024-09-16T04:08:34.859180+0000","last_became_active":"2024-09-16T04:08:15.466434+0000","last_became_peered":"2024-09-16T04:08:15.466434+0000","last_unstale":"2024-09-16T04:08:34.859180+0000","last_undegraded":"2024-09-16T04:08:34.859180+0000","last_fullsized":"2024-09-16T04:08:34.859180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:22.942299+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.022807241999999998,"stat_sum":{"num_bytes":4276224,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":1974,"num_write":13,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,5,9,3,13,11,6],"acting":[12,5,9,3,13,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.2","version":"27'2","reported_seq":79,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.089112+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:39.089112+0000","last_peered":"2024-09-16T04:08:39.089112+0000","last_clean":"2024-09-16T04:08:39.089112+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:39.089112+0000","last_undegraded":"2024-09-16T04:08:39.089112+0000","last_fullsized":"2024-09-16T04:08:39.089112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"44'27","reported_seq":138,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.854772+0000","last_change":"2024-09-16T04:08:34.855244+0000","last_active":"2024-09-16T04:08:34.854772+0000","last_peered":"2024-09-16T04:08:34.854772+0000","last_clean":"2024-09-16T04:08:34.854772+0000","last_became_active":"2024-09-16T04:08:14.946050+0000","last_became_peered":"2024-09-16T04:08:14.946050+0000","last_unstale":"2024-09-16T04:08:34.854772+0000","last_undegraded":"2024-09-16T04:08:34.854772+0000","last_fullsized":"2024-09-16T04:08:34.854772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.524085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074286000000000003,"stat_sum":{"num_bytes":3260416,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":6201,"num_write":18,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,2,13,4,6,5],"acting":[15,9,2,13,4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"3.5","version":"54'16","reported_seq":159,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.183520+0000","last_change":"2024-09-16T04:08:37.090079+0000","last_active":"2024-09-16T04:08:39.183520+0000","last_peered":"2024-09-16T04:08:39.183520+0000","last_clean":"2024-09-16T04:08:39.183520+0000","last_became_active":"2024-09-16T04:08:14.934767+0000","last_became_peered":"2024-09-16T04:08:14.934767+0000","last_unstale":"2024-09-16T04:08:39.183520+0000","last_undegraded":"2024-09-16T04:08:39.183520+0000","last_fullsized":"2024-09-16T04:08:39.183520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:29.039479+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.022584913000000002,"stat_sum":{"num_bytes":1867776,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":8524,"num_write":30,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,14,9,10,13,8],"acting":[5,6,14,9,10,13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.845651+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:34.845651+0000","last_peered":"2024-09-16T04:08:34.845651+0000","last_clean":"2024-09-16T04:08:34.845651+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:34.845651+0000","last_undegraded":"2024-09-16T04:08:34.845651+0000","last_fullsized":"2024-09-16T04:08:34.845651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"54'62","reported_seq":185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.086852+0000","last_change":"2024-09-16T04:08:37.089043+0000","last_active":"2024-09-16T04:08:39.086852+0000","last_peered":"2024-09-16T04:08:39.086852+0000","last_clean":"2024-09-16T04:08:39.086852+0000","last_became_active":"2024-09-16T04:08:15.495248+0000","last_became_peered":"2024-09-16T04:08:15.495248+0000","last_unstale":"2024-09-16T04:08:39.086852+0000","last_undegraded":"2024-09-16T04:08:39.086852+0000","last_fullsized":"2024-09-16T04:08:39.086852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:41.688692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022430454999999998,"stat_sum":{"num_bytes":6373376,"num_objects":7,"num_object_clones":1,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":89,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,3,15,6,0],"acting":[10,12,14,3,15,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"1"},{"start":"b","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.854108+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:34.854108+0000","last_peered":"2024-09-16T04:08:34.854108+0000","last_clean":"2024-09-16T04:08:34.854108+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:34.854108+0000","last_undegraded":"2024-09-16T04:08:34.854108+0000","last_fullsized":"2024-09-16T04:08:34.854108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":105,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.841417+0000","last_change":"2024-09-16T04:08:34.842225+0000","last_active":"2024-09-16T04:08:34.841417+0000","last_peered":"2024-09-16T04:08:34.841417+0000","last_clean":"2024-09-16T04:08:34.841417+0000","last_became_active":"2024-09-16T04:08:14.939313+0000","last_became_peered":"2024-09-16T04:08:14.939313+0000","last_unstale":"2024-09-16T04:08:34.841417+0000","last_undegraded":"2024-09-16T04:08:34.841417+0000","last_fullsized":"2024-09-16T04:08:34.841417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:34.461123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001339235,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1874,"num_write":2,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,7,4,11,6,13],"acting":[14,8,7,4,11,6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.840047+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:34.840047+0000","last_peered":"2024-09-16T04:08:34.840047+0000","last_clean":"2024-09-16T04:08:34.840047+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:34.840047+0000","last_undegraded":"2024-09-16T04:08:34.840047+0000","last_fullsized":"2024-09-16T04:08:34.840047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"42'13","reported_seq":112,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T04:08:34.841239+0000","last_change":"2024-09-16T04:08:34.841973+0000","last_active":"2024-09-16T04:08:34.841239+0000","last_peered":"2024-09-16T04:08:34.841239+0000","last_clean":"2024-09-16T04:08:34.841239+0000","last_became_active":"2024-09-16T04:08:15.494877+0000","last_became_peered":"2024-09-16T04:08:15.494877+0000","last_unstale":"2024-09-16T04:08:34.841239+0000","last_undegraded":"2024-09-16T04:08:34.841239+0000","last_fullsized":"2024-09-16T04:08:34.841239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:38.279958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015310949999999999,"stat_sum":{"num_bytes":1114112,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":6,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7,15,5,11,9,0],"acting":[14,7,15,5,11,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T04:08:39.089555+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:39.089555+0000","last_peered":"2024-09-16T04:08:39.089555+0000","last_clean":"2024-09-16T04:08:39.089555+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:39.089555+0000","last_undegraded":"2024-09-16T04:08:39.089555+0000","last_fullsized":"2024-09-16T04:08:39.089555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":56606720,"num_objects":57,"num_object_clones":11,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":232,"num_read_kb":43658,"num_write":383,"num_write_kb":62848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":92160000,"data_stored":104701952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":456,"ondisk_log_size":456,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247817,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33804,"kb_used_data":6776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338036,"statfs":{"total":96636764160,"available":96602148864,"internally_reserved":0,"allocated":6938624,"data_stored":7656433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":5636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":5771264,"data_stored":5891057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247818,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37932,"kb_used_data":6744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333908,"statfs":{"total":96636764160,"available":96597921792,"internally_reserved":0,"allocated":6905856,"data_stored":7013361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313227,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":4704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":4816896,"data_stored":4883747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280523,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33268,"kb_used_data":6240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":6389760,"data_stored":6630796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38188,"kb_used_data":7000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333652,"statfs":{"total":96636764160,"available":96597659648,"internally_reserved":0,"allocated":7168000,"data_stored":7671180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":4500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":4608000,"data_stored":4619660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":4436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":4542464,"data_stored":4795788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34624,"kb_used_data":7596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337216,"statfs":{"total":96636764160,"available":96601309184,"internally_reserved":0,"allocated":7778304,"data_stored":8113567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280524,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":9644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":9875456,"data_stored":10809260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280523,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36168,"kb_used_data":9140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335672,"statfs":{"total":96636764160,"available":96599728128,"internally_reserved":0,"allocated":9359360,"data_stored":10251679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247817,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36632,"kb_used_data":5440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335208,"statfs":{"total":96636764160,"available":96599252992,"internally_reserved":0,"allocated":5570560,"data_stored":5592593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247819,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":4596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":4706304,"data_stored":4391921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247817,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":5160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":5283840,"data_stored":6060824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247818,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39636,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332204,"statfs":{"total":96636764160,"available":96596176896,"internally_reserved":0,"allocated":8650752,"data_stored":8729585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247817,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":5268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":5394432,"data_stored":5954328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4358144,"data_stored":4698112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6041600,"data_stored":7831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":4497408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4026368,"data_stored":4026368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4620288,"data_stored":5382144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6438912,"data_stored":7274496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7970816,"data_stored":8364032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3878912,"data_stored":4222976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4911104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":3813376,"data_stored":4399104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7426048,"data_stored":9314304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8994816,"data_stored":11481088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6647808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8626176,"data_stored":9854976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":5091328,"data_stored":5525504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":5931008,"data_stored":6270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:39.871 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T04:08:39.871 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:08:39.871 INFO:tasks.thrashosds.thrasher:inject_pause on osd.13 2024-09-16T04:08:39.871 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-16T04:08:39.871 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-16T04:08:39.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok config set filestore_inject_stall 3 2024-09-16T04:08:39.872 INFO:tasks.rados.rados.0.smithi204.stdout:175: writing smithi20431790-44 from 2588672 to 3063808 tid 2 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:175: writing smithi20431790-44 from 3063808 to 3358720 tid 3 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:176: read oid 7 snap -1 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:176: expect (ObjNum 81 snap 8 seq_num 81) 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:177: delete oid 1 current snap is 13 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 14 v 89 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 91 (ObjNum 88 snap 11 seq_num 88) dirty exists 2024-09-16T04:08:39.875 INFO:tasks.rados.rados.0.smithi204.stdout:170: expect (ObjNum 60 snap 4 seq_num 60) 2024-09-16T04:08:39.876 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:39.876 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:39.896 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:08:39.918 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:39.916+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:39.946 INFO:tasks.rados.rados.0.smithi204.stdout:173: finishing write tid 1 to smithi20431790-30 2024-09-16T04:08:39.946 INFO:tasks.rados.rados.0.smithi204.stdout:173: finishing write tid 2 to smithi20431790-30 2024-09-16T04:08:39.946 INFO:tasks.rados.rados.0.smithi204.stdout:173: finishing write tid 3 to smithi20431790-30 2024-09-16T04:08:39.946 INFO:tasks.rados.rados.0.smithi204.stdout:173: finishing write tid 4 to smithi20431790-30 2024-09-16T04:08:39.946 INFO:tasks.rados.rados.0.smithi204.stdout:173: finishing write tid 5 to smithi20431790-30 2024-09-16T04:08:39.946 INFO:tasks.rados.rados.0.smithi204.stdout:173: oid 30 updating version 0 to 94 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:173: oid 30 updating version 94 to 96 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:173: oid 30 version 96 is already newer than 95 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:173: oid 30 version 96 is already newer than 93 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 96 (ObjNum 90 snap 13 seq_num 90) dirty exists 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:173: left oid 30 (ObjNum 90 snap 13 seq_num 90) 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: finishing write tid 1 to smithi20431790-44 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: finishing write tid 2 to smithi20431790-44 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: finishing write tid 3 to smithi20431790-44 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: finishing write tid 4 to smithi20431790-44 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: finishing write tid 5 to smithi20431790-44 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: oid 44 updating version 0 to 23 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: oid 44 updating version 23 to 25 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: oid 44 updating version 25 to 26 2024-09-16T04:08:39.947 INFO:tasks.rados.rados.0.smithi204.stdout:175: oid 44 version 26 is already newer than 24 2024-09-16T04:08:39.948 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 26 (ObjNum 91 snap 13 seq_num 91) dirty exists 2024-09-16T04:08:39.948 INFO:tasks.rados.rados.0.smithi204.stdout:175: left oid 44 (ObjNum 91 snap 13 seq_num 91) 2024-09-16T04:08:39.948 INFO:tasks.rados.rados.0.smithi204.stdout:176: expect (ObjNum 81 snap 8 seq_num 81) 2024-09-16T04:08:39.987 INFO:tasks.rados.rados.0.smithi204.stdout:170: done (6 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:171: done (5 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:172: done (4 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:173: done (3 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:175: done (2 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:176: done (1 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:177: done (0 left) 2024-09-16T04:08:39.988 INFO:tasks.rados.rados.0.smithi204.stdout:178: delete oid 47 current snap is 13 2024-09-16T04:08:39.993 INFO:tasks.rados.rados.0.smithi204.stdout:178: done (0 left) 2024-09-16T04:08:39.993 INFO:tasks.rados.rados.0.smithi204.stdout:179: snap_create 2024-09-16T04:08:39.997 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:39.991+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:40.015 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-16T04:08:40.015 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:40.062 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:40.062 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:40.076 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:08:40.099 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:40.095+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:40.198 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:40.198 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:40.199 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:40.194+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:40.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:08:40.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:40.301 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:40.298+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:40.373 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:40.374 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:40.388 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:08:40.401 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:40.397+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:40.430 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:40.430 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:40.451 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:40.451 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:40.468 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:40.469 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:40.490 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:40.501 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:40.497+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:40.509 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:40.510 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:40.531 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:40.559 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:40.560 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:40.560 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:40.560 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:40.560 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:40.569 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:08:40.574 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:40.594 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:40.594 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:40.602 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:40.596+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:40.617 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:40.638 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:40.638 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:40.661 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:40.662 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:40.685 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:1 3.4s0 3:23761325:::smithi20431790-1:head [append 0~32768,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932663+0000", 2024-09-16T04:08:40.690 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.754132780999999, 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.02373635, 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 1 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.691 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932663+0000", 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932663+0000", 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.692 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932666+0000", 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7250000000000002e-06 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932808+0000", 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000142378 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932830+0000", 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2036e-05 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.693 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932846+0000", 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5410999999999999e-05 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932978+0000", 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013213 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933221+0000", 2024-09-16T04:08:40.694 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000243615 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.938491+0000", 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0052696100000000001 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003604777 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.695 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956246+0000", 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.014150190999999999 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956399+0000", 2024-09-16T04:08:40.696 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015347700000000001 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:2 3.4s0 3:23761325:::smithi20431790-1:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:40.697 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.753919123999999, 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.025102767000000002, 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 2 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.698 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:40.699 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.699 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.699 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.699 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.699 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:40.699 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932878+0000", 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.477e-06 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932887+0000", 2024-09-16T04:08:40.700 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.0529999999999996e-06 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932905+0000", 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7428e-05 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932920+0000", 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5568000000000001e-05 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.701 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939855+0000", 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069352210000000001 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940080+0000", 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022506800000000001 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:08:40.702 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011671030000000001 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949403+0000", 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0081551360000000003 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957764+0000", 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083610560000000004 2024-09-16T04:08:40.703 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957979+0000", 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021565700000000001 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:3 3.4s0 3:23761325:::smithi20431790-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:40.704 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.753856464999998, 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.046611916000000003, 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 3 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.705 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932940+0000", 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1799999999999999e-06 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.706 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932969+0000", 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8867e-05 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932988+0000", 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9173000000000001e-05 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933004+0000", 2024-09-16T04:08:40.707 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5821999999999999e-05 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941757+0000", 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087529989999999992 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.708 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941968+0000", 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021104500000000001 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958099+0000", 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016130480999999999 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.709 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958362+0000", 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026272900000000001 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979551+0000", 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021189619999999999 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:13 3.bs0 3:ddc630b6:::smithi20431790-5:head [append 0~81920,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.933640+0000", 2024-09-16T04:08:40.710 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.753156175000001, 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022034354999999999, 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 13 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933640+0000", 2024-09-16T04:08:40.711 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933640+0000", 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.712 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933642+0000", 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3e-06 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933867+0000", 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000225391 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933902+0000", 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4989e-05 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933920+0000", 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7575999999999999e-05 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.714 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934047+0000", 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000126759 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934273+0000", 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000226634 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940231+0000", 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0059576619999999999 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.715 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955383+0000", 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01515176 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955515+0000", 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013239 2024-09-16T04:08:40.716 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955674+0000", 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000158894 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:14 3.bs0 3:ddc630b6:::smithi20431790-5:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.752841117999999, 2024-09-16T04:08:40.717 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.029025773000000001, 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 14 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.718 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933956+0000", 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.455e-06 2024-09-16T04:08:40.719 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933963+0000", 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1450000000000002e-06 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933980+0000", 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6909999999999999e-05 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.720 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.721 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.721 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933994+0000", 2024-09-16T04:08:40.721 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4236999999999999e-05 2024-09-16T04:08:40.721 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.721 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.722 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.722 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.944227+0000", 2024-09-16T04:08:40.722 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010232893 2024-09-16T04:08:40.722 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.722 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.722 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.947374+0000", 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031466839999999999 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952631+0000", 2024-09-16T04:08:40.723 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005256635 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956032+0000", 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0034013939999999999 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.962586+0000", 2024-09-16T04:08:40.724 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006554458 2024-09-16T04:08:40.725 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.725 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.725 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.725 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.962980+0000", 2024-09-16T04:08:40.725 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00039396199999999998 2024-09-16T04:08:40.725 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:15 3.bs0 3:ddc630b6:::smithi20431790-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.752780332, 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044909575, 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.726 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 15 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.727 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934017+0000", 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.302e-06 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934023+0000", 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2140000000000001e-06 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.728 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934039+0000", 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5690999999999999e-05 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934052+0000", 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3728e-05 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955822+0000", 2024-09-16T04:08:40.729 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021769189000000001 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956014+0000", 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019218999999999999 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963151+0000", 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00713688 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.730 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963673+0000", 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052261899999999999 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978925+0000", 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015251762 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:24 3.4s0 3:20db2d5a:::smithi20431790-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.731 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.745555489000001, 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039181856000000001, 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 24 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.732 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941242+0000", 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4670000000000001e-06 2024-09-16T04:08:40.733 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2519999999999996e-06 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941266+0000", 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8502999999999999e-05 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.734 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941281+0000", 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4642e-05 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949167+0000", 2024-09-16T04:08:40.735 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078853970000000006 2024-09-16T04:08:40.736 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.736 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.736 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.736 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949385+0000", 2024-09-16T04:08:40.736 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000218929 2024-09-16T04:08:40.736 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961609+0000", 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012224016000000001 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.737 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.738 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961801+0000", 2024-09-16T04:08:40.738 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019127200000000001 2024-09-16T04:08:40.738 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.738 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.738 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.738 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980422+0000", 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018621378000000001 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.739 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:28 3.4s0 3:29c49be6:::smithi20431790-10:head [append 0~163840,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.740 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:40.740 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.741311651, 2024-09-16T04:08:40.740 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039204422000000003, 2024-09-16T04:08:40.740 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.740 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.740 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 28 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.741 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.742 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.742 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:40.742 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.742 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.742 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945486+0000", 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.743 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945810+0000", 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000323713 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945834+0000", 2024-09-16T04:08:40.744 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3858000000000001e-05 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945851+0000", 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7099999999999999e-05 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.745 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965628+0000", 2024-09-16T04:08:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019777501999999999 2024-09-16T04:08:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965920+0000", 2024-09-16T04:08:40.746 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00029198400000000002 2024-09-16T04:08:40.747 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.747 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.747 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.747 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967512+0000", 2024-09-16T04:08:40.747 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015920190000000001 2024-09-16T04:08:40.748 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.748 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.748 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.748 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984489+0000", 2024-09-16T04:08:40.748 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016976872 2024-09-16T04:08:40.748 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.749 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.749 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.749 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984601+0000", 2024-09-16T04:08:40.749 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000111969 2024-09-16T04:08:40.749 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984689+0000", 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7554999999999998e-05 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.750 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:29 3.4s0 3:29c49be6:::smithi20431790-10:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.740917048, 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041668905999999999, 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.751 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.752 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.752 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.752 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.752 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 29 2024-09-16T04:08:40.752 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.752 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.753 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945880+0000", 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7060000000000001e-06 2024-09-16T04:08:40.754 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945888+0000", 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8630000000000008e-06 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.755 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945906+0000", 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8165e-05 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945921+0000", 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4233000000000001e-05 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.756 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.969983+0000", 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.024062503999999998 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970182+0000", 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000198784 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.975849+0000", 2024-09-16T04:08:40.757 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0056673210000000003 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984708+0000", 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088582690000000002 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987208+0000", 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0025007359999999999 2024-09-16T04:08:40.758 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987548+0000", 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033932500000000002 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:30 3.4s0 3:29c49be6:::smithi20431790-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.740829352999999, 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044609479, 2024-09-16T04:08:40.759 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 30 2024-09-16T04:08:40.760 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.761 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:40.762 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.762 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.762 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.762 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.762 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945968+0000", 2024-09-16T04:08:40.762 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5629999999999999e-06 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945975+0000", 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.063e-06 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.763 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945994+0000", 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9415999999999998e-05 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946009+0000", 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4969e-05 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.764 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.765 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978603+0000", 2024-09-16T04:08:40.765 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.032593521 2024-09-16T04:08:40.765 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.765 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.765 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.765 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978799+0000", 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000196336 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987651+0000", 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088521820000000001 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987845+0000", 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019347900000000001 2024-09-16T04:08:40.766 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990576+0000", 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027309499999999998 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:40 3.bs0 3:dfb3e098:::smithi20431790-14:head [append 0~229376,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.952713+0000", 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.734083195, 2024-09-16T04:08:40.767 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022448215000000001, 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 40 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952713+0000", 2024-09-16T04:08:40.768 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.769 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.769 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.769 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.772 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952713+0000", 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952721+0000", 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.354e-06 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952886+0000", 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000164876 2024-09-16T04:08:40.773 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952914+0000", 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8016000000000001e-05 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952932+0000", 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8329999999999999e-05 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.774 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956125+0000", 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031927489999999999 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956389+0000", 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026436100000000001 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958429+0000", 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0020400119999999999 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.775 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964627+0000", 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061974220000000002 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.974978+0000", 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010351552 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.975161+0000", 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018254299999999999 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.776 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:41 3.bs0 3:dfb3e098:::smithi20431790-14:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.952962+0000", 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.73383364, 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.023896552000000001, 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.777 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 41 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952962+0000", 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952962+0000", 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.778 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952964+0000", 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8029999999999999e-06 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952973+0000", 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6160000000000002e-06 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952993+0000", 2024-09-16T04:08:40.779 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0055999999999999e-05 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953019+0000", 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6647000000000001e-05 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959843+0000", 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068240439999999996 2024-09-16T04:08:40.780 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.960062+0000", 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021857800000000001 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.781 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961175+0000", 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011126860000000001 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964874+0000", 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003699871 2024-09-16T04:08:40.782 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.783 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.783 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.783 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.976657+0000", 2024-09-16T04:08:40.783 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011782907 2024-09-16T04:08:40.783 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.783 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.784 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.784 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.976859+0000", 2024-09-16T04:08:40.784 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000201344 2024-09-16T04:08:40.784 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.784 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.784 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:42 3.bs0 3:dfb3e098:::smithi20431790-14:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.733755362, 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030384648, 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.785 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.786 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.786 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.786 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.786 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.786 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 42 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.787 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.788 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.788 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.788 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:40.788 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.788 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.788 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.789 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.789 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953042+0000", 2024-09-16T04:08:40.789 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2750000000000001e-06 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953049+0000", 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3819999999999998e-06 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953071+0000", 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.213e-05 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.790 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953086+0000", 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4691e-05 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966890+0000", 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013804448 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968398+0000", 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015072379999999999 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977027+0000", 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086299559999999994 2024-09-16T04:08:40.792 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.793 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.793 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.793 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977565+0000", 2024-09-16T04:08:40.793 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00053773700000000005 2024-09-16T04:08:40.793 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.793 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983425+0000", 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058597909999999996 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:46 3.4s0 3:285c2ad8:::smithi20431790-16:head [append 0~262144,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:40.794 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.729444059999999, 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.033667818000000002, 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 46 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.795 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.796 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.796 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.796 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:40.796 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.796 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.796 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.797 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957361+0000", 2024-09-16T04:08:40.798 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8279999999999992e-06 2024-09-16T04:08:40.798 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.798 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.798 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.798 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957823+0000", 2024-09-16T04:08:40.798 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000462912 2024-09-16T04:08:40.799 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.799 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.799 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.799 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957847+0000", 2024-09-16T04:08:40.800 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3329999999999999e-05 2024-09-16T04:08:40.800 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.800 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.800 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.800 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:08:40.800 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7459999999999999e-05 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980701+0000", 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022836372000000001 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.801 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.802 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.802 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980884+0000", 2024-09-16T04:08:40.802 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018340000000000001 2024-09-16T04:08:40.802 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.802 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.802 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.803 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982553+0000", 2024-09-16T04:08:40.803 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0016689350000000001 2024-09-16T04:08:40.803 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.803 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.803 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.803 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987566+0000", 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050129570000000002 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990888+0000", 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0033219679999999998 2024-09-16T04:08:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.805 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.805 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.805 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991019+0000", 2024-09-16T04:08:40.805 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013165599999999999 2024-09-16T04:08:40.805 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.805 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.806 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.806 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.806 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.806 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:47 3.4s0 3:285c2ad8:::smithi20431790-16:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.806 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:40.806 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.728902560999998, 2024-09-16T04:08:40.807 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.037486141000000001, 2024-09-16T04:08:40.807 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.807 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.807 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.807 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.807 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.808 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.808 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 47 2024-09-16T04:08:40.808 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.808 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.808 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.808 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.809 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:40.809 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.809 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.809 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.809 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.809 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:40.810 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.810 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.810 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.810 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.810 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957895+0000", 2024-09-16T04:08:40.810 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6950000000000001e-06 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957903+0000", 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8679999999999999e-06 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.811 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957923+0000", 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0001e-05 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957942+0000", 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9368000000000002e-05 2024-09-16T04:08:40.812 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.813 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.813 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.813 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985229+0000", 2024-09-16T04:08:40.813 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027287148000000001 2024-09-16T04:08:40.813 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.813 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.814 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.814 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985602+0000", 2024-09-16T04:08:40.814 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037240199999999998 2024-09-16T04:08:40.814 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.814 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.814 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986575+0000", 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00097305500000000001 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989838+0000", 2024-09-16T04:08:40.815 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0032630300000000001 2024-09-16T04:08:40.816 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.816 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.816 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.816 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995213+0000", 2024-09-16T04:08:40.816 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053754359999999999 2024-09-16T04:08:40.816 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.817 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.817 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.817 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995379+0000", 2024-09-16T04:08:40.817 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000166138 2024-09-16T04:08:40.817 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.817 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.818 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.818 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.818 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.818 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:48 3.4s0 3:285c2ad8:::smithi20431790-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.818 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:40.818 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.728833866999999, 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041004387000000003, 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.819 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.820 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 48 2024-09-16T04:08:40.820 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.820 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.820 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.820 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.820 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.821 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957963+0000", 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.437e-06 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957969+0000", 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8370000000000002e-06 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957990+0000", 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0883999999999999e-05 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.822 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958003+0000", 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3377000000000001e-05 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.988975+0000", 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030971772000000002 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989143+0000", 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016802000000000001 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.823 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996033+0000", 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068901420000000001 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996181+0000", 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014787700000000001 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.998966+0000", 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027850409999999998 2024-09-16T04:08:40.824 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:56 3.bs0 3:d6a8a443:::smithi20431790-19:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.970652+0000", 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.716143589000001, 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021015676, 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.825 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 56 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970652+0000", 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970652+0000", 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.826 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970654+0000", 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7799999999999999e-06 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970665+0000", 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0961999999999999e-05 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.971043+0000", 2024-09-16T04:08:40.827 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000378119 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972008+0000", 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00096480999999999997 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980279+0000", 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0082709789999999995 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.828 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980461+0000", 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018214199999999999 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.981135+0000", 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00067413599999999998 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983452+0000", 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002316458 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.829 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991507+0000", 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0080552409999999994 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991668+0000", 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000161049 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.830 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:57 3.bs0 3:d6a8a443:::smithi20431790-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 23.714733600999999, 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027398674000000001, 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 57 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972064+0000", 2024-09-16T04:08:40.832 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6199999999999999e-06 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972089+0000", 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5650999999999999e-05 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972112+0000", 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2408999999999998e-05 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.833 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972129+0000", 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7263999999999999e-05 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982377+0000", 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010247460999999999 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982554+0000", 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000177071 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.834 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995331+0000", 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012777227 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995447+0000", 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011627400000000001 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.999461+0000", 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040136970000000001 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.835 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:406 3.bs0 3:de4d7231:::smithi20431790-45:head [read 0~3047424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:35.844070+0000", 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.8427257990000001, 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.023954726999999999, 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.836 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 406 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844070+0000", 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844070+0000", 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.837 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844072+0000", 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844080+0000", 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7329999999999992e-06 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844103+0000", 2024-09-16T04:08:40.838 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2345999999999999e-05 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844119+0000", 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6079999999999999e-05 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844369+0000", 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025003100000000001 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:40.839 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844385+0000", 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5777000000000002e-05 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.849444+0000", 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050592329999999998 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.849668+0000", 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000224322 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.840 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.868025+0000", 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018356448000000001 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:407 3.bs0 3:de4d7231:::smithi20431790-45:head [read 0~3047424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:35.844175+0000", 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.8426211949999995, 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.028643892000000001, 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:40.841 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 407 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844175+0000", 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:40.842 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844175+0000", 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844176+0000", 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3030000000000001e-06 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844184+0000", 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0199999999999994e-06 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.843 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844209+0000", 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5179000000000001e-05 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844223+0000", 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3929e-05 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844431+0000", 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020774300000000001 2024-09-16T04:08:40.844 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844440+0000", 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3470000000000005e-06 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.853399+0000", 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089589700000000001 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.853689+0000", 2024-09-16T04:08:40.845 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028963699999999998 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.872818+0000", 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019129764 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:40.846 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:40.847 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:40.848 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:40.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:40.709+0000 7f94a1d9b640 0 -- 172.21.15.32:0/2531468908 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7f94a421de20 msgr2=0x7f94a4220210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:40.848 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:40.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:08:40.850 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:40.850 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:40.851 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:40.852 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:40.844+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:40.852 INFO:tasks.rados.rados.0.smithi204.stdout:179: done (0 left) 2024-09-16T04:08:40.852 INFO:tasks.rados.rados.0.smithi204.stdout:180: read oid 27 snap -1 2024-09-16T04:08:40.852 INFO:tasks.rados.rados.0.smithi204.stdout:180: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:40.852 INFO:tasks.rados.rados.0.smithi204.stdout:181: snap_create 2024-09-16T04:08:40.860 INFO:tasks.rados.rados.0.smithi204.stdout:180: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:08:40.949 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:40.945+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:40.978 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:40.978 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:40.979 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:40.979 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:40.993 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:08:41.050 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:41.046+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:41.108 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-16T04:08:41.118 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:41.118 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:41.118 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:41.118 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:41.118 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:41.132 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:08:41.151 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:41.147+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:41.251 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:41.249+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:41.299 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:41.299 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:41.299 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:41.299 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941612+0000", 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.356572534000001, 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071844949999999999, 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941612+0000", 2024-09-16T04:08:41.300 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941612+0000", 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941613+0000", 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3e-07 2024-09-16T04:08:41.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941792+0000", 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017855400000000001 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941870+0000", 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8842000000000002e-05 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941894+0000", 2024-09-16T04:08:41.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3252e-05 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942666+0000", 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00077190099999999997 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942698+0000", 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2625e-05 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948704+0000", 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0060053759999999998 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948797+0000", 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3214999999999994e-05 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:1, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.304 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941639+0000", 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.35654585, 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070030550000000002, 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941639+0000", 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941639+0000", 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941640+0000", 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.271e-06 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941719+0000", 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8349999999999994e-05 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.306 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941762+0000", 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.3089e-05 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941841+0000", 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9293000000000001e-05 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942163+0000", 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00032229399999999999 2024-09-16T04:08:41.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942185+0000", 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2044000000000001e-05 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948587+0000", 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0064015629999999999 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948642+0000", 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5151000000000001e-05 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942033+0000", 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.356152234, 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0077733439999999997, 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.309 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942033+0000", 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942033+0000", 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.310 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942035+0000", 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9470000000000002e-06 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942072+0000", 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7144999999999998e-05 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942099+0000", 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6857999999999999e-05 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.311 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942119+0000", 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0503e-05 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.944999+0000", 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002879759 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945033+0000", 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4575e-05 2024-09-16T04:08:41.312 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949625+0000", 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0045913600000000001 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949806+0000", 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018119699999999999 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.313 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.35608903, 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013450198999999999, 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.314 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942097+0000", 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.2600000000000001e-07 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942125+0000", 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8059e-05 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.315 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942143+0000", 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8116000000000001e-05 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942165+0000", 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1959000000000001e-05 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943008+0000", 2024-09-16T04:08:41.316 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00084321400000000001 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943028+0000", 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0132999999999998e-05 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955472+0000", 2024-09-16T04:08:41.317 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012443511000000001 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4281000000000003e-05 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=3, reqid=client.4631.0:22, at_version=33'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:41.318 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.351580397999999, 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01145176, 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:41.319 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946606+0000", 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5939999999999999e-06 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946710+0000", 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010391399999999999 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.320 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948852+0000", 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0021415980000000002 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948878+0000", 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.597e-05 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948998+0000", 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120791 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.321 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949037+0000", 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8680000000000002e-05 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957977+0000", 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089400739999999992 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958056+0000", 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9139000000000002e-05 2024-09-16T04:08:41.322 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=4, reqid=client.4631.0:23, at_version=33'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.349220410000001, 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0091600550000000003, 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.323 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948966+0000", 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.297e-06 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.324 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949000+0000", 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4164e-05 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949155+0000", 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015466000000000001 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949174+0000", 2024-09-16T04:08:41.325 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9658999999999999e-05 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950232+0000", 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0010573970000000001 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950253+0000", 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1172999999999999e-05 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.326 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958067+0000", 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078142119999999992 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958124+0000", 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7493e-05 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 34/31 ECSubWrite(tid=0, reqid=client.4631.0:31, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.950569+0000", 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.347616097, 2024-09-16T04:08:41.327 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073218780000000004, 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950569+0000", 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950569+0000", 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.328 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950570+0000", 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.331e-06 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951371+0000", 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00080050200000000003 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951428+0000", 2024-09-16T04:08:41.329 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7703e-05 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951449+0000", 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1033e-05 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951579+0000", 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012978999999999999 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.330 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.951598+0000", 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9369999999999999e-05 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957819+0000", 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062202129999999996 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957891+0000", 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1935999999999997e-05 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.331 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:105 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 24.273218299, 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092492909999999998, 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 105 2024-09-16T04:08:41.332 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.333 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3600000000000003e-07 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024972+0000", 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.7140000000000001e-06 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024982+0000", 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9620000000000005e-06 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.334 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024990+0000", 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5680000000000002e-06 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028098+0000", 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031086120000000002 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028201+0000", 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010293099999999999 2024-09-16T04:08:41.335 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031909+0000", 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003707587 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031957+0000", 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8812e-05 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.336 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.034216+0000", 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0022583690000000001 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 39/31 ECSubWrite(tid=20, reqid=client.4631.0:188, at_version=39'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.298459223999998, 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006975902, 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.337 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:21.999726+0000", 2024-09-16T04:08:41.338 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2999999999999999e-07 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000284+0000", 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00055737799999999998 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000312+0000", 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8495000000000001e-05 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.339 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000334+0000", 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1472e-05 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000511+0000", 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017761200000000001 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.000536+0000", 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4981999999999999e-05 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.340 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.006615+0000", 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0060784639999999996 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:22.006702+0000", 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6669000000000007e-05 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 48/31 ECSubWrite(tid=144, reqid=osd.10.0:144, at_version=48'64, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:41.341 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.443192030000001, 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0074089819999999997, 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.342 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854993+0000", 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.3e-07 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855048+0000", 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4134e-05 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.343 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855079+0000", 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1656000000000003e-05 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855103+0000", 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3431999999999999e-05 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855473+0000", 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037027300000000001 2024-09-16T04:08:41.344 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855498+0000", 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4649000000000001e-05 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862292+0000", 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0067949220000000001 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862402+0000", 2024-09-16T04:08:41.345 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000109286 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.855160+0000", 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.443025066000001, 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0072702000000000001, 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.346 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855160+0000", 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855160+0000", 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855161+0000", 2024-09-16T04:08:41.347 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0100000000000001e-06 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855206+0000", 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.5050999999999999e-05 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855228+0000", 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.211e-05 2024-09-16T04:08:41.348 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855245+0000", 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7295999999999998e-05 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855456+0000", 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021067199999999999 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855483+0000", 2024-09-16T04:08:41.349 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6971999999999999e-05 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862349+0000", 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068661390000000003 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862430+0000", 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0950000000000003e-05 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.350 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.856635+0000", 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.441549374999999, 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083497799999999994, 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856635+0000", 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.351 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856635+0000", 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856637+0000", 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.477e-06 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.352 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856685+0000", 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.7941000000000001e-05 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856704+0000", 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8929000000000001e-05 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856717+0000", 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3210000000000001e-05 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.353 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856900+0000", 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000182523 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.856926+0000", 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6639e-05 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864905+0000", 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0079792370000000001 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.354 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864985+0000", 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9824e-05 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:419 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.094618+0000", 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 5.2035669909999998, 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0075378199999999998, 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.355 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 419 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094618+0000", 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.356 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094618+0000", 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094621+0000", 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5700000000000001e-06 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094639+0000", 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7771999999999999e-05 2024-09-16T04:08:41.357 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094679+0000", 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.0058999999999997e-05 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094696+0000", 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6809000000000001e-05 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094872+0000", 2024-09-16T04:08:41.358 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017605499999999999 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.095037+0000", 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016505400000000001 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.102156+0000", 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071185010000000002 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.359 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:420 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.094736+0000", 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 5.2034484519999999, 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090100189999999993, 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 420 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.360 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094736+0000", 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094736+0000", 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.361 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094738+0000", 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1999999999999999e-06 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094747+0000", 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7799999999999995e-06 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094775+0000", 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7602000000000001e-05 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.362 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094785+0000", 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9499999999999996e-06 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.096701+0000", 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0019158339999999999 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.097017+0000", 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00031663299999999998 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.103746+0000", 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0067290199999999996 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:421 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 5.2033188089999998, 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013252471, 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.364 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 421 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094867+0000", 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1999999999999998e-07 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094872+0000", 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.9590000000000003e-06 2024-09-16T04:08:41.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094883+0000", 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1616e-05 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094895+0000", 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1226999999999999e-05 2024-09-16T04:08:41.367 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.103881+0000", 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089864100000000002 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.104033+0000", 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000152342 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.108118+0000", 2024-09-16T04:08:41.368 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040850970000000002 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 53/31 ECSubWrite(tid=179, reqid=client.4631.0:427, at_version=53'57, trim_to=0'0, roll_forward_to=52'55))", 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.159490+0000", 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 5.138695137, 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070368239999999997, 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.369 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.159490+0000", 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.159490+0000", 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.159513+0000", 2024-09-16T04:08:41.370 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3195999999999999e-05 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.159905+0000", 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00039184799999999998 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.159951+0000", 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.5834999999999997e-05 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.371 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.159978+0000", 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7242000000000001e-05 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.160179+0000", 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000201597 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.160211+0000", 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1826000000000003e-05 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.372 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.166441+0000", 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062297560000000004 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.166527+0000", 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.5524000000000003e-05 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.373 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 54/31 ECSubWrite(tid=254, reqid=osd.11.0:254, at_version=54'19, trim_to=0'0, roll_forward_to=52'17))", 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.2304539219999997, 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078308470000000002, 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.374 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.067732+0000", 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5700000000000002e-07 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.067795+0000", 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.3640999999999996e-05 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.375 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.067827+0000", 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1643000000000002e-05 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.067852+0000", 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4709e-05 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.068108+0000", 2024-09-16T04:08:41.376 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000256149 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.068134+0000", 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5738999999999999e-05 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075451+0000", 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073172619999999997 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.377 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075562+0000", 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011094699999999999 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 54/31 ECSubWrite(tid=70, reqid=osd.12.0:69, at_version=0'0, trim_to=0'0, roll_forward_to=54'25))", 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.2278060249999996, 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098073039999999993, 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.378 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070381+0000", 2024-09-16T04:08:41.379 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0999999999999998e-06 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070410+0000", 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8619000000000002e-05 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070469+0000", 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9508e-05 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.380 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070492+0000", 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3373000000000001e-05 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070735+0000", 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024256899999999999 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070760+0000", 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4825999999999999e-05 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.381 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080100+0000", 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093401479999999995 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080186+0000", 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6161000000000004e-05 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:08:41.382 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.071900+0000", 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.2262844590000004, 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087262239999999994, 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071900+0000", 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.383 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071900+0000", 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071901+0000", 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5599999999999995e-07 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072005+0000", 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000104143 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.384 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072036+0000", 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0833000000000001e-05 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072059+0000", 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2643e-05 2024-09-16T04:08:41.385 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.388 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.388 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.388 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072247+0000", 2024-09-16T04:08:41.388 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018837699999999999 2024-09-16T04:08:41.388 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072274+0000", 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7469000000000001e-05 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080491+0000", 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0082170969999999996 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080627+0000", 2024-09-16T04:08:41.389 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013510599999999999 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 54/31 ECSubWrite(tid=186, reqid=osd.10.0:186, at_version=54'62, trim_to=0'0, roll_forward_to=53'60))", 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.072123+0000", 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 4.2260618900000004, 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.008002304, 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:41.390 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072123+0000", 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:41.391 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072123+0000", 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072124+0000", 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4869999999999999e-06 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072167+0000", 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2598000000000001e-05 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.392 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072190+0000", 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3269999999999999e-05 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072491+0000", 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00030076700000000002 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072709+0000", 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000217636 2024-09-16T04:08:41.393 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072739+0000", 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9896e-05 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080021+0000", 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0072823829999999999 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080125+0000", 2024-09-16T04:08:41.394 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000104267 2024-09-16T04:08:41.395 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.395 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.395 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.395 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:41.395 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:41.395 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:41.396 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:08:41.397 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:41.393+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:41.497 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:41.493+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:41.528 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:41.529 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:41.529 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:41.529 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:41.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:08:41.599 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:41.596+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:41.660 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:41.660 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:41.660 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:41.660 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:41.660 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:41.674 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:08:41.700 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:41.698+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:41.797 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:41.797 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:41.797 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:41.800 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:41.801 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.801 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 33/31 ECSubWrite(tid=0, reqid=client.4631.0:1, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:41.801 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.936937+0000", 2024-09-16T04:08:41.801 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.855426314999999, 2024-09-16T04:08:41.801 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036197389999999999, 2024-09-16T04:08:41.801 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.802 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.802 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.802 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.802 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.802 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.802 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936937+0000", 2024-09-16T04:08:41.803 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.803 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.803 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.804 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.804 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936937+0000", 2024-09-16T04:08:41.804 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.804 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.804 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.804 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.805 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936938+0000", 2024-09-16T04:08:41.805 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8700000000000005e-07 2024-09-16T04:08:41.805 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.805 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.805 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.805 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937010+0000", 2024-09-16T04:08:41.806 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1798000000000006e-05 2024-09-16T04:08:41.806 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.806 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.806 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.806 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937026+0000", 2024-09-16T04:08:41.806 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6515e-05 2024-09-16T04:08:41.807 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.807 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.807 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.807 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937038+0000", 2024-09-16T04:08:41.807 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1745e-05 2024-09-16T04:08:41.807 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.808 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.808 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.808 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937131+0000", 2024-09-16T04:08:41.808 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2917000000000005e-05 2024-09-16T04:08:41.808 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.809 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.809 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.809 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937141+0000", 2024-09-16T04:08:41.809 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8630000000000003e-06 2024-09-16T04:08:41.809 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.809 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.810 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.810 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940522+0000", 2024-09-16T04:08:41.810 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033812500000000001 2024-09-16T04:08:41.810 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.810 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.811 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.811 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940557+0000", 2024-09-16T04:08:41.811 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4863999999999997e-05 2024-09-16T04:08:41.811 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.811 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.812 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.812 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.812 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.812 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 34/31 ECSubWrite(tid=13, reqid=client.4631.0:119, at_version=34'4, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:41.812 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.044683+0000", 2024-09-16T04:08:41.812 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.747680404, 2024-09-16T04:08:41.813 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036719470000000001, 2024-09-16T04:08:41.813 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.813 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.813 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.813 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.814 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.814 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.814 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044683+0000", 2024-09-16T04:08:41.814 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.814 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.814 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044683+0000", 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.815 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044684+0000", 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4799999999999998e-07 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044702+0000", 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8221000000000001e-05 2024-09-16T04:08:41.816 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.817 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.817 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.817 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044712+0000", 2024-09-16T04:08:41.817 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5670000000000001e-06 2024-09-16T04:08:41.817 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044720+0000", 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8519999999999993e-06 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.818 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044787+0000", 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6511000000000001e-05 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.044805+0000", 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7907999999999999e-05 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.819 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048311+0000", 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035057410000000002 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048355+0000", 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4598999999999998e-05 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.820 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.032601+0000", 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.759762891999999, 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051555500000000001, 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032601+0000", 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032601+0000", 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.822 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032601+0000", 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4799999999999999e-07 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032728+0000", 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012668 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.823 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032747+0000", 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9174999999999999e-05 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032762+0000", 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4929999999999999e-05 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032855+0000", 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3209999999999997e-05 2024-09-16T04:08:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032868+0000", 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2632e-05 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037657+0000", 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047889880000000001 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037756+0000", 2024-09-16T04:08:41.826 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9487000000000005e-05 2024-09-16T04:08:41.826 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.826 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.826 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.826 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.826 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.827 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:08:41.827 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.029509+0000", 2024-09-16T04:08:41.827 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 14.762854355, 2024-09-16T04:08:41.827 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042047259999999998, 2024-09-16T04:08:41.827 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.828 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.828 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.828 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.828 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.828 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.828 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029509+0000", 2024-09-16T04:08:41.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.829 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.829 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.829 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.829 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029509+0000", 2024-09-16T04:08:41.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029510+0000", 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8599999999999998e-07 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.830 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029589+0000", 2024-09-16T04:08:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9385e-05 2024-09-16T04:08:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.831 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029624+0000", 2024-09-16T04:08:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5191999999999998e-05 2024-09-16T04:08:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029736+0000", 2024-09-16T04:08:41.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011158999999999999 2024-09-16T04:08:41.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.833 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.833 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.833 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029920+0000", 2024-09-16T04:08:41.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018407800000000001 2024-09-16T04:08:41.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.834 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.834 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029948+0000", 2024-09-16T04:08:41.834 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7509999999999999e-05 2024-09-16T04:08:41.834 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.033585+0000", 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036369089999999998 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.835 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.033714+0000", 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012947600000000001 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 48/31 ECSubWrite(tid=61, reqid=osd.12.0:58, at_version=0'0, trim_to=0'0, roll_forward_to=48'23))", 2024-09-16T04:08:41.836 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.849006+0000", 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.943357767, 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039274089999999998, 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.837 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849006+0000", 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849006+0000", 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849007+0000", 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3990000000000001e-06 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849032+0000", 2024-09-16T04:08:41.839 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4409999999999998e-05 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849057+0000", 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5646000000000001e-05 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.840 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849079+0000", 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2175999999999999e-05 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849308+0000", 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00022881999999999999 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.849333+0000", 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4354000000000001e-05 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852828+0000", 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0034950770000000001 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852933+0000", 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010552699999999999 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.842 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851282+0000", 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.941081243999999, 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0044507169999999999, 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.843 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851282+0000", 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851282+0000", 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851283+0000", 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3e-07 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.844 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851339+0000", 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5911000000000001e-05 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851373+0000", 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3705999999999999e-05 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851396+0000", 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3016000000000001e-05 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851782+0000", 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000386733 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851809+0000", 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6976000000000001e-05 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855633+0000", 2024-09-16T04:08:41.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038232819999999999 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855733+0000", 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000100463 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.940910198999999, 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0070627650000000004, 2024-09-16T04:08:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.848 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851455+0000", 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.206e-06 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851524+0000", 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8961999999999995e-05 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.849 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851547+0000", 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3893e-05 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851567+0000", 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9102000000000001e-05 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852770+0000", 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001203815 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.850 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852794+0000", 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3527e-05 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858409+0000", 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056155329999999998 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858516+0000", 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000106727 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.851 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.939813532000001, 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064106290000000002, 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.852 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852551+0000", 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6700000000000003e-07 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.853 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852640+0000", 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9158000000000003e-05 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852673+0000", 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2775999999999999e-05 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852698+0000", 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5661999999999999e-05 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.854 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852915+0000", 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000216281 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853049+0000", 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013407299999999999 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858910+0000", 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005861163 2024-09-16T04:08:41.855 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858961+0000", 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0949000000000003e-05 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857345+0000", 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.935018913, 2024-09-16T04:08:41.856 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050507549999999997, 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857345+0000", 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857345+0000", 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.857 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857347+0000", 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4729999999999999e-06 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857399+0000", 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2036000000000001e-05 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.858 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857442+0000", 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.3007999999999999e-05 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857513+0000", 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.0668999999999997e-05 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857758+0000", 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024462600000000001 2024-09-16T04:08:41.859 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857786+0000", 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8013000000000001e-05 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862295+0000", 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045093989999999999 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.860 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862395+0000", 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000100531 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=226, reqid=client.4631.0:375, at_version=48'39, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.861583+0000", 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.930780383, 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0041041569999999998, 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.861 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861583+0000", 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861583+0000", 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.862 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861586+0000", 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3199999999999998e-06 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861923+0000", 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033719099999999998 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861984+0000", 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.1498e-05 2024-09-16T04:08:41.863 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862006+0000", 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2163000000000001e-05 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862230+0000", 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00022329000000000001 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862256+0000", 2024-09-16T04:08:41.864 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5902999999999999e-05 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.865597+0000", 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033413739999999998 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.865687+0000", 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0418000000000001e-05 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=148, reqid=osd.10.0:147, at_version=0'0, trim_to=0'0, roll_forward_to=48'46))", 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.920990838, 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0071558660000000003, 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:08:41.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871375+0000", 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2929999999999999e-06 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871406+0000", 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1232999999999997e-05 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871444+0000", 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7688999999999998e-05 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871469+0000", 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4936e-05 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871646+0000", 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017657299999999999 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871673+0000", 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7044999999999999e-05 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878426+0000", 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067531659999999997 2024-09-16T04:08:41.869 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878529+0000", 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010293099999999999 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.919921575, 2024-09-16T04:08:41.870 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0087467719999999999, 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872444+0000", 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4490000000000002e-06 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872725+0000", 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00028078400000000001 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872755+0000", 2024-09-16T04:08:41.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9329999999999999e-05 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872775+0000", 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0750999999999998e-05 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872977+0000", 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020181499999999999 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873000+0000", 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3254000000000001e-05 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881108+0000", 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0081072399999999999 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881189+0000", 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1149000000000005e-05 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.874 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=150, reqid=osd.10.0:150, at_version=48'48, trim_to=0'0, roll_forward_to=48'46))", 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.917300873, 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0059911859999999999, 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.875 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.876 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875065+0000", 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1399999999999998e-06 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875118+0000", 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3582000000000003e-05 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875151+0000", 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2311999999999998e-05 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875174+0000", 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.283e-05 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875376+0000", 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020205700000000001 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875407+0000", 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1792999999999999e-05 2024-09-16T04:08:41.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880960+0000", 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055526580000000002 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881054+0000", 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3814000000000007e-05 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=229, reqid=client.4631.0:377, at_version=48'41, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.878070+0000", 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.914293456999999, 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0040691579999999998, 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878070+0000", 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878070+0000", 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878072+0000", 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0229999999999999e-06 2024-09-16T04:08:41.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878200+0000", 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012739399999999999 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878238+0000", 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8566000000000003e-05 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.882 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878262+0000", 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3915000000000001e-05 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878437+0000", 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017530900000000001 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878503+0000", 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6092000000000004e-05 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882057+0000", 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035532010000000002 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882139+0000", 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2657999999999994e-05 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.884 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=153, reqid=osd.10.0:150, at_version=0'0, trim_to=0'0, roll_forward_to=48'48))", 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.882336+0000", 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.910027288, 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035549190000000001, 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.885 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882336+0000", 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882336+0000", 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882339+0000", 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.227e-06 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882380+0000", 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1678000000000003e-05 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882407+0000", 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7061999999999999e-05 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.882427+0000", 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9785000000000001e-05 2024-09-16T04:08:41.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883006+0000", 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00057852700000000001 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883030+0000", 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4079000000000001e-05 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.885795+0000", 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027655000000000002 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.885891+0000", 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6061000000000001e-05 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 53/31 ECSubWrite(tid=244, reqid=client.4631.0:408, at_version=53'50, trim_to=0'0, roll_forward_to=52'48))", 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:08:41.889 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 5.9096888390000002, 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0058951469999999999, 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:08:41.890 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882676+0000", 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.093e-06 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883042+0000", 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00036582100000000001 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883079+0000", 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7622e-05 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883112+0000", 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2685999999999998e-05 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883631+0000", 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00051925400000000003 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883755+0000", 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000124003 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.888484+0000", 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047283309999999997 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.893 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.888570+0000", 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6336999999999997e-05 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.894 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 53/31 ECSubWrite(tid=179, reqid=client.4631.0:427, at_version=53'57, trim_to=0'0, roll_forward_to=52'55))", 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 5.6342233559999997, 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060365560000000002, 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.895 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158141+0000", 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5600000000000001e-07 2024-09-16T04:08:41.896 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158605+0000", 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046468300000000002 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158631+0000", 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.544e-05 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158655+0000", 2024-09-16T04:08:41.897 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3699000000000001e-05 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158836+0000", 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018186299999999999 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158868+0000", 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1809e-05 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.164050+0000", 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051816689999999999 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.164177+0000", 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012693700000000001 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:08:41.899 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7248146250000005, 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053899769999999998, 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.900 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067550+0000", 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7999999999999995e-07 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067604+0000", 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4209000000000002e-05 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.901 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067647+0000", 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2871999999999999e-05 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067671+0000", 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4283000000000001e-05 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.068006+0000", 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033519600000000001 2024-09-16T04:08:41.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.068032+0000", 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5303000000000002e-05 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072844+0000", 2024-09-16T04:08:41.903 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048127869999999998 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072939+0000", 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4647000000000004e-05 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 54/31 ECSubWrite(tid=71, reqid=osd.12.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=54'29))", 2024-09-16T04:08:41.904 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.071217+0000", 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7211467379999998, 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050560379999999997, 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071217+0000", 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071217+0000", 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071219+0000", 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1900000000000002e-06 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071246+0000", 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7293000000000001e-05 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.906 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071290+0000", 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.3309000000000002e-05 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071321+0000", 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0972000000000001e-05 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071431+0000", 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011064 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.071441+0000", 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6430000000000007e-06 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.076187+0000", 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047463560000000002 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.076273+0000", 2024-09-16T04:08:41.908 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5635000000000003e-05 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 54/31 ECSubWrite(tid=186, reqid=osd.10.0:186, at_version=54'62, trim_to=0'0, roll_forward_to=53'60))", 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7144967690000001, 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0057063770000000003, 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:41.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:41.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.04e-07 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077893+0000", 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6029000000000001e-05 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077913+0000", 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9653999999999999e-05 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:41.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077941+0000", 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8561999999999999e-05 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.078109+0000", 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016742100000000001 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.078136+0000", 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.711e-05 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.083476+0000", 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053401189999999999 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.083573+0000", 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7277999999999999e-05 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:41.913 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-16T04:08:41.916 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:180: done (1 left) 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:181: done (0 left) 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:182: rollback oid 12 current snap is 15 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 12 to 8 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:183: copy_from oid 25 from oid 47 current snap is 15 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:184: rollback oid 7 current snap is 15 2024-09-16T04:08:41.917 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 7 to 13 2024-09-16T04:08:41.918 INFO:tasks.rados.rados.0.smithi204.stdout:185: delete oid 3 current snap is 15 2024-09-16T04:08:41.918 INFO:tasks.rados.rados.0.smithi204.stdout:182: finishing rollback tid 0 to smithi20431790-12 2024-09-16T04:08:41.918 INFO:tasks.rados.rados.0.smithi204.stdout:182: finishing rollback tid 1 to smithi20431790-12 2024-09-16T04:08:41.918 INFO:tasks.rados.rados.0.smithi204.stdout:185: done (3 left) 2024-09-16T04:08:41.918 INFO:tasks.rados.rados.0.smithi204.stdout:186: snap_remove snap 11 2024-09-16T04:08:41.918 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:41.910+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:42.016 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:42.012+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:42.048 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:42.048 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:42.048 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:42.049 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:42.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:08:42.117 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:42.110+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:42.185 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:42.185 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:42.185 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:42.185 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:42.185 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:42.199 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:08:42.218 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:42.212+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:42.319 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:42.315+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:42.321 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.381010505999999, 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003553507, 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:42.322 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936337+0000", 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.53e-07 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936618+0000", 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000281468 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.323 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936637+0000", 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8558000000000001e-05 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936667+0000", 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0105000000000001e-05 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936800+0000", 2024-09-16T04:08:42.324 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013247399999999999 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936810+0000", 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0178e-05 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939853+0000", 2024-09-16T04:08:42.325 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030432739999999999 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939890+0000", 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7197000000000003e-05 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 33/31 ECSubWrite(tid=4, reqid=client.4631.0:19, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.376019252999999, 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046610189999999998, 2024-09-16T04:08:42.326 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.327 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941329+0000", 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0720000000000001e-06 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941664+0000", 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033524 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.328 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941685+0000", 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0548999999999999e-05 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941695+0000", 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0696999999999999e-05 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942769+0000", 2024-09-16T04:08:42.329 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010735 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942777+0000", 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4950000000000008e-06 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945953+0000", 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031750350000000001 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945989+0000", 2024-09-16T04:08:42.330 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6430999999999997e-05 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.941725+0000", 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.375622196999998, 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039764700000000002, 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.331 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941725+0000", 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941725+0000", 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941726+0000", 2024-09-16T04:08:42.332 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1600000000000001e-07 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941741+0000", 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5693e-05 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942725+0000", 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00098408400000000009 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.333 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942736+0000", 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0366e-05 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942797+0000", 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0976e-05 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942808+0000", 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1644000000000001e-05 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.334 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945662+0000", 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028535570000000001 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945701+0000", 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9634e-05 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.335 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 33/31 ECSubWrite(tid=5, reqid=client.4631.0:20, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.942764+0000", 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.374583114, 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003248595, 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.336 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942764+0000", 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942764+0000", 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942765+0000", 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6799999999999999e-07 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.337 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942785+0000", 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9865999999999999e-05 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942796+0000", 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0947999999999999e-05 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942807+0000", 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1678999999999999e-05 2024-09-16T04:08:42.338 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943191+0000", 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038316899999999999 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943222+0000", 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1565e-05 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945992+0000", 2024-09-16T04:08:42.339 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027703659999999998 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.946013+0000", 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0234e-05 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=162, reqid=client.4631.0:37, at_version=34'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.368628979, 2024-09-16T04:08:42.340 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005624703, 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.341 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7399999999999999e-07 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948775+0000", 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6127e-05 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948794+0000", 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9264000000000001e-05 2024-09-16T04:08:42.342 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948804+0000", 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7499999999999998e-06 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949606+0000", 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080285899999999995 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949616+0000", 2024-09-16T04:08:42.343 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6900000000000004e-06 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954283+0000", 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046664230000000003 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954343+0000", 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0316000000000003e-05 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.344 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=163, reqid=client.4631.0:38, at_version=34'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.367486852999999, 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045180239999999998, 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.345 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949861+0000", 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1149999999999999e-06 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949901+0000", 2024-09-16T04:08:42.346 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9934000000000001e-05 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949919+0000", 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7291000000000001e-05 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949932+0000", 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3383e-05 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950027+0000", 2024-09-16T04:08:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4493000000000005e-05 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950035+0000", 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2689999999999999e-06 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954354+0000", 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0043187429999999999 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.348 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954378+0000", 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4796000000000001e-05 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.977853+0000", 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.339494245000001, 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003416283, 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.349 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977853+0000", 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977853+0000", 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977854+0000", 2024-09-16T04:08:42.350 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6899999999999997e-07 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977868+0000", 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4144e-05 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977876+0000", 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5529999999999993e-06 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977883+0000", 2024-09-16T04:08:42.351 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4339999999999997e-06 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978377+0000", 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00049401100000000004 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978386+0000", 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7800000000000006e-06 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.352 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.981233+0000", 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028476030000000002 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.981269+0000", 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6089e-05 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:42.353 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 16.284596150999999, 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049720880000000004, 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.354 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3900000000000001e-07 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032842+0000", 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0807e-05 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032862+0000", 2024-09-16T04:08:42.355 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9660000000000002e-05 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032872+0000", 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0726e-05 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032974+0000", 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101142 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.356 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032984+0000", 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0713000000000001e-05 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037679+0000", 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046946610000000001 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037723+0000", 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4140000000000001e-05 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.357 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.287720354999999, 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047342010000000004, 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.358 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5700000000000002e-07 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029691+0000", 2024-09-16T04:08:42.359 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3400999999999998e-05 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029741+0000", 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9975000000000002e-05 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029761+0000", 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0356999999999998e-05 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.360 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.030019+0000", 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00025759600000000002 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.030043+0000", 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4301999999999999e-05 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034280+0000", 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004236638 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.361 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034361+0000", 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1274999999999997e-05 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851343+0000", 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.466004085, 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045365689999999998, 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.362 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851343+0000", 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851343+0000", 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851344+0000", 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7199999999999999e-07 2024-09-16T04:08:42.363 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851382+0000", 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8405999999999998e-05 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851404+0000", 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1878999999999998e-05 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851423+0000", 2024-09-16T04:08:42.364 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9332999999999999e-05 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851586+0000", 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016265299999999999 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851613+0000", 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6709000000000001e-05 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.365 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855819+0000", 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042065119999999999 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855880+0000", 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0504999999999998e-05 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:42.366 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.465884633, 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055937950000000004, 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.367 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0999999999999999e-07 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851488+0000", 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4587e-05 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.368 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851502+0000", 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4797000000000001e-05 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851514+0000", 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1073000000000001e-05 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853720+0000", 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00220616 2024-09-16T04:08:42.369 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853745+0000", 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5653e-05 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857009+0000", 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003263775 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.370 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857056+0000", 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7240000000000002e-05 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.465226713, 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051176499999999996, 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.371 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852121+0000", 2024-09-16T04:08:42.372 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7599999999999996e-07 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852170+0000", 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9035000000000001e-05 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852191+0000", 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0472999999999999e-05 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.373 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852205+0000", 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4048e-05 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852390+0000", 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018541099999999999 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852418+0000", 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7985999999999999e-05 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.374 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857089+0000", 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046703320000000001 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857238+0000", 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014958899999999999 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:42.375 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.465095238, 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050972430000000004, 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:08:42.376 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852253+0000", 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1099999999999995e-07 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852285+0000", 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1846e-05 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.377 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852299+0000", 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4659e-05 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852310+0000", 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1287999999999999e-05 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853693+0000", 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001382826 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.378 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853719+0000", 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6016e-05 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857307+0000", 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003587369 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857349+0000", 2024-09-16T04:08:42.379 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2527999999999997e-05 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=226, reqid=client.4631.0:375, at_version=48'39, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.455068207, 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050701030000000003, 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.380 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862280+0000", 2024-09-16T04:08:42.381 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2389999999999999e-06 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862380+0000", 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9331000000000002e-05 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862396+0000", 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6789000000000001e-05 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862409+0000", 2024-09-16T04:08:42.382 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2384e-05 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862627+0000", 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021813 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862652+0000", 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5519000000000001e-05 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.383 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867248+0000", 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045958509999999998 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867349+0000", 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010086000000000001 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:08:42.384 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.444705062000001, 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0069465819999999998, 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:08:42.385 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872645+0000", 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.384e-06 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872912+0000", 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00026752299999999998 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.386 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872958+0000", 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5624999999999998e-05 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872982+0000", 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4443e-05 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873128+0000", 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014554100000000001 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.387 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873152+0000", 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4428000000000001e-05 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879494+0000", 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0063421629999999996 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879589+0000", 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4475000000000006e-05 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=84, reqid=osd.13.0:82, at_version=0'0, trim_to=0'0, roll_forward_to=48'21))", 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.873149+0000", 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.444198618, 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039646339999999999, 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.389 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873149+0000", 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873149+0000", 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.390 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873150+0000", 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5629999999999999e-06 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873175+0000", 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5173000000000001e-05 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873201+0000", 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5559e-05 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.391 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873221+0000", 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0460000000000001e-05 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873378+0000", 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000156849 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873405+0000", 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6886e-05 2024-09-16T04:08:42.392 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.877013+0000", 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036079829999999999 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.877113+0000", 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010016100000000001 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.393 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=244, reqid=client.4631.0:408, at_version=53'50, trim_to=0'0, roll_forward_to=52'48))", 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.882968+0000", 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 6.4343793590000002, 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042950569999999997, 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882968+0000", 2024-09-16T04:08:42.394 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882968+0000", 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882969+0000", 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1600000000000001e-07 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.395 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883391+0000", 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00042243599999999999 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883443+0000", 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2101999999999997e-05 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883467+0000", 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4239999999999998e-05 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.396 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883773+0000", 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00030540899999999998 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883798+0000", 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5689000000000001e-05 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.887168+0000", 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0033699540000000001 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.397 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.887263+0000", 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4511000000000004e-05 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=246, reqid=client.4631.0:409, at_version=53'51, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 6.4240689739999999, 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0085214520000000005, 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.398 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.399 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893281+0000", 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4099999999999998e-06 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893613+0000", 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033196199999999999 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893658+0000", 2024-09-16T04:08:42.400 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5498999999999999e-05 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893682+0000", 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4159e-05 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893893+0000", 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000210845 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893920+0000", 2024-09-16T04:08:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6931999999999999e-05 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901667+0000", 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0077466979999999998 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901800+0000", 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013294700000000001 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.402 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=247, reqid=client.4631.0:410, at_version=53'52, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 6.4204137580000005, 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004935488, 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.403 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896935+0000", 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8959999999999999e-06 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.404 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897016+0000", 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0438000000000005e-05 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897061+0000", 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4988999999999999e-05 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897084+0000", 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3139999999999999e-05 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.405 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897310+0000", 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000226424 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897334+0000", 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4083e-05 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901810+0000", 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0044760260000000001 2024-09-16T04:08:42.406 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901869+0000", 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8492000000000002e-05 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 5.2498560330000004, 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053273050000000001, 2024-09-16T04:08:42.407 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.408 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067492+0000", 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0299999999999998e-07 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067551+0000", 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8916000000000003e-05 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067582+0000", 2024-09-16T04:08:42.409 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1472e-05 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067606+0000", 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3485999999999998e-05 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000125365 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.410 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067741+0000", 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9890000000000004e-06 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072715+0000", 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049738159999999998 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072818+0000", 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103458 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.411 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.412 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.412 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.412 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:42.413 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:08:42.419 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:42.414+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:42.521 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:42.517+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:42.582 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:42.582 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:42.582 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:42.582 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:42.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:08:42.622 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:42.620+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:42.722 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:42.722 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:42.722 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:42.722 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:42.722 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:42.723 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:42.720+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:42.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:08:42.825 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:42.820+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:42.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:42.859 INFO:tasks.rados.rados.0.smithi204.stdout:186: done (3 left) 2024-09-16T04:08:42.859 INFO:tasks.rados.rados.0.smithi204.stdout:187: copy_from oid 29 from oid 36 current snap is 15 2024-09-16T04:08:42.859 INFO:tasks.rados.rados.0.smithi204.stdout:182: finishing rollback tid 2 to smithi20431790-12 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 12 v 30 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:183: finishing copy_from to smithi20431790-25 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:183: got expected ENOENT (src dne) 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:183: finishing copy_from racing read to smithi20431790-25 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:184: finishing rollback tid 0 to smithi20431790-7 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:184: finishing rollback tid 1 to smithi20431790-7 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:184: finishing rollback tid 2 to smithi20431790-7 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 7 v 31 (ObjNum 81 snap 8 seq_num 81) dirty exists 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:182: done (3 left) 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:183: done (2 left) 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:184: done (1 left) 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:188: read oid 14 snap 14 2024-09-16T04:08:42.860 INFO:tasks.rados.rados.0.smithi204.stdout:188: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:42.861 INFO:tasks.rados.rados.0.smithi204.stdout:189: snap_remove snap 8 2024-09-16T04:08:42.862 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4347.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.178596925000001, 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.078945607000000001, 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.863 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4347", 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.864 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680776+0000", 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680789+0000", 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3190000000000001e-05 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680818+0000", 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9221999999999999e-05 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680843+0000", 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5341e-05 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681117+0000", 2024-09-16T04:08:42.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027343099999999998 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681133+0000", 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6121999999999999e-05 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756693+0000", 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.075560459999999996 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756940+0000", 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000246987 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 5", 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.757281+0000", 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034121100000000001 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758584+0000", 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013029490000000001 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759577+0000", 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00099302500000000003 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759652+0000", 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4519999999999998e-05 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759718+0000", 2024-09-16T04:08:42.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5798999999999998e-05 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.172885858999997, 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.074795126000000003, 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.870 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.871 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686485+0000", 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.658e-06 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686493+0000", 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4970000000000001e-06 2024-09-16T04:08:42.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686508+0000", 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4491999999999999e-05 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686518+0000", 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0458e-05 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686592+0000", 2024-09-16T04:08:42.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3489000000000001e-05 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686600+0000", 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9230000000000002e-06 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758022+0000", 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.071421947 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758412+0000", 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038979599999999998 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758762+0000", 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00035026099999999999 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.760052+0000", 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012898219999999999 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761194+0000", 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001142505 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761242+0000", 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7673000000000002e-05 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761278+0000", 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6604999999999999e-05 2024-09-16T04:08:42.876 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.081572+0000", 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.777797182999997, 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018489616, 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.877 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 117 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081572+0000", 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081572+0000", 2024-09-16T04:08:42.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081574+0000", 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6330000000000001e-06 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081585+0000", 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1769e-05 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081604+0000", 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8746e-05 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.081622+0000", 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7482e-05 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098224+0000", 2024-09-16T04:08:42.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.016602888 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098357+0000", 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013302 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.098549+0000", 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019195 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.881 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099717+0000", 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0011676830000000001 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.099932+0000", 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021476500000000001 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.100007+0000", 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5343e-05 2024-09-16T04:08:42.882 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.100062+0000", 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4336999999999998e-05 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:02.421215+0000", 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.438154119000004, 2024-09-16T04:08:42.883 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018607317000000002, 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 165 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421215+0000", 2024-09-16T04:08:42.884 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421215+0000", 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421216+0000", 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7700000000000003e-07 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421222+0000", 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3559999999999998e-06 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421232+0000", 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3360000000000001e-06 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.421241+0000", 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2960000000000004e-06 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436230+0000", 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014989426 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436396+0000", 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016566399999999999 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.436855+0000", 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00045879200000000002 2024-09-16T04:08:42.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.438245+0000", 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013906890000000001 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439687+0000", 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001442062 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439765+0000", 2024-09-16T04:08:42.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7405999999999997e-05 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:02.439822+0000", 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7413000000000001e-05 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:10 3.2s0 3:47904bf5:::smithi20431790-4:head [append 0~65536,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.927271906000001, 2024-09-16T04:08:42.889 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018864736, 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 10 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.890 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932099+0000", 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2199999999999999e-06 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932178+0000", 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932195+0000", 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7448999999999998e-05 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932210+0000", 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5338000000000001e-05 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.892 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932298+0000", 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8108000000000004e-05 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932407+0000", 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000108142 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933041+0000", 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00063471100000000004 2024-09-16T04:08:42.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935398+0000", 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0023565420000000001 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950884+0000", 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015486107000000001 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950962+0000", 2024-09-16T04:08:42.894 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7970000000000001e-05 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:11 3.2s0 3:47904bf5:::smithi20431790-4:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.927114420999999, 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018963179, 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.895 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 11 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:42.896 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.897 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9400000000000005e-07 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932260+0000", 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9710000000000003e-06 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932272+0000", 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1394e-05 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932280+0000", 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6540000000000005e-06 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933560+0000", 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012794550000000001 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933703+0000", 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014327099999999999 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934311+0000", 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00060811199999999995 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:08:42.900 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001087619 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951109+0000", 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015710114000000001 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951218+0000", 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010889499999999999 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.901 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:12 3.2s0 3:47904bf5:::smithi20431790-4:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.927043130000001, 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026513838000000001, 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 12 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.902 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932327+0000", 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4600000000000003e-07 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932331+0000", 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932343+0000", 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2442999999999999e-05 2024-09-16T04:08:42.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932356+0000", 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2947e-05 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935242+0000", 2024-09-16T04:08:42.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028857570000000001 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935348+0000", 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010570500000000001 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951277+0000", 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015929606999999998 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951330+0000", 2024-09-16T04:08:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2148000000000003e-05 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.958840+0000", 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0075102520000000002 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:25 3.8s0 3:11971f68:::smithi20431790-9:head [append 0~147456,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.907 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938661+0000", 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.920708132000001, 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018494454, 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 25 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938661+0000", 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938661+0000", 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.384e-06 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938779+0000", 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011633699999999999 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938793+0000", 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4586000000000001e-05 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938803+0000", 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2790000000000004e-06 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938868+0000", 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5343000000000001e-05 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938988+0000", 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000120093 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939579+0000", 2024-09-16T04:08:42.911 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00059097900000000005 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943478+0000", 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038985410000000002 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957071+0000", 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013593010000000001 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.912 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957155+0000", 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4901999999999995e-05 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:26 3.8s0 3:11971f68:::smithi20431790-9:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938825+0000", 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.920543751, 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018583538, 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.913 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 26 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938825+0000", 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938825+0000", 2024-09-16T04:08:42.914 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938826+0000", 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4300000000000003e-07 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938830+0000", 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1740000000000002e-06 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.915 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938838+0000", 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5900000000000002e-06 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938844+0000", 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5930000000000002e-06 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.939943+0000", 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010986889999999999 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.916 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940019+0000", 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.6460999999999999e-05 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940434+0000", 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00041424300000000001 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.943480+0000", 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030464889999999999 2024-09-16T04:08:42.917 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957322+0000", 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013841628 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957409+0000", 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7027999999999994e-05 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.918 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:27 3.8s0 3:11971f68:::smithi20431790-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.920514439000002, 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023242002000000001, 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 27 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.919 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3399999999999999e-07 2024-09-16T04:08:42.920 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938866+0000", 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0725e-05 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938877+0000", 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1277999999999999e-05 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938884+0000", 2024-09-16T04:08:42.921 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1969999999999999e-06 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940649+0000", 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001764126 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940737+0000", 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8554000000000006e-05 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.922 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957784+0000", 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017047128000000002 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9390999999999999e-05 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.962097+0000", 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042329689999999996 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.923 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:39 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.911910604999999, 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018733970999999999, 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.924 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 39 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.925 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947459+0000", 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4000000000000002e-07 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947462+0000", 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8959999999999999e-06 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947471+0000", 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8680000000000005e-06 2024-09-16T04:08:42.926 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947477+0000", 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3300000000000004e-06 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950100+0000", 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026232159999999998 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950184+0000", 2024-09-16T04:08:42.927 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3891e-05 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963530+0000", 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013345658 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963589+0000", 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8748000000000001e-05 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.928 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966192+0000", 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026038239999999998 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:45 3.2s0 3:43e872cf:::smithi20431790-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.907004687000001, 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020624611000000001, 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.929 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 45 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.930 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952365+0000", 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.79e-07 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952366+0000", 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1400000000000001e-06 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.931 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952369+0000", 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5889999999999999e-06 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952372+0000", 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7460000000000001e-06 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959119+0000", 2024-09-16T04:08:42.932 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067464609999999996 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959501+0000", 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038236699999999999 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970077+0000", 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010575599 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.933 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970122+0000", 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5423999999999997e-05 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.972989+0000", 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028670060000000001 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.934 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:296 3.2s0 3:47aa9112:::smithi20431790-43:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.842711281, 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.022372174000000002, 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.935 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 296 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:08:42.936 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016661+0000", 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3730000000000001e-06 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016676+0000", 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4735999999999999e-05 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.937 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016718+0000", 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1995e-05 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016743+0000", 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4697000000000001e-05 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016889+0000", 2024-09-16T04:08:42.938 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014660300000000001 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016902+0000", 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3125000000000001e-05 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.939 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.028135+0000", 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011232884 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.028307+0000", 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017155600000000001 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029615+0000", 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001308299 2024-09-16T04:08:42.940 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038024+0000", 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0084091359999999993 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038830+0000", 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080528499999999999 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.941 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039030+0000", 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000200485 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:297 3.2s0 3:47aa9112:::smithi20431790-43:head [rollback 6] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.842566683999999, 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023235478, 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.942 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 297 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016803+0000", 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8999999999999995e-07 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016809+0000", 2024-09-16T04:08:42.944 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.383e-06 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016840+0000", 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1494e-05 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016852+0000", 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1909999999999999e-05 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.945 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016990+0000", 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013789100000000001 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016997+0000", 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4989999999999997e-06 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.032055+0000", 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015057667 2024-09-16T04:08:42.946 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.032258+0000", 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000203131 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034469+0000", 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00221097 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.947 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038026+0000", 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003557017 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039824+0000", 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001797482 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040038+0000", 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021414399999999999 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.948 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:298 3.2s0 3:47aa9112:::smithi20431790-43:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.842474698, 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026598553, 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.949 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 298 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.950 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016895+0000", 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7199999999999997e-07 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016901+0000", 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2970000000000003e-06 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016914+0000", 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.364e-05 2024-09-16T04:08:42.951 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016927+0000", 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3084e-05 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017040+0000", 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000112871 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:42.952 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017045+0000", 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3240000000000002e-06 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.035806+0000", 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018760585 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.036098+0000", 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029218199999999999 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.953 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.037257+0000", 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001159207 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039176+0000", 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019182789999999999 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043033+0000", 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003857002 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.954 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043493+0000", 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046021000000000001 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:299 3.2s0 3:471dade1:::smithi20431790-28:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.842425672999999, 2024-09-16T04:08:42.955 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.033537681, 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 299 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:08:42.956 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016944+0000", 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3799999999999997e-07 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.957 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016949+0000", 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3199999999999999e-06 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016963+0000", 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3137e-05 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016972+0000", 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3600000000000002e-06 2024-09-16T04:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017101+0000", 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000129536 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017109+0000", 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1080000000000004e-06 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040363+0000", 2024-09-16T04:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023254582999999999 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040426+0000", 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2757999999999998e-05 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040920+0000", 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00049433799999999998 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.960 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.046996+0000", 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060755890000000002 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050239+0000", 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032429770000000002 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050481+0000", 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024233699999999999 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.961 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:300 3.2s0 3:471dade1:::smithi20431790-28:head [rollback 7] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.842385854, 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.034915521999999997, 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.962 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 300 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.963 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016984+0000", 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.75e-07 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016987+0000", 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5599999999999998e-06 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016999+0000", 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.117e-05 2024-09-16T04:08:42.964 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017008+0000", 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4399999999999994e-06 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017152+0000", 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014403800000000001 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:42.965 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017158+0000", 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4580000000000001e-06 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043910+0000", 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026752120000000001 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.044066+0000", 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000156408 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.966 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.045632+0000", 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0015661690000000001 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047448+0000", 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018157169999999999 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.051829+0000", 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0043809010000000004 2024-09-16T04:08:42.967 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.051899+0000", 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9865999999999998e-05 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:301 3.2s0 3:471dade1:::smithi20431790-28:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:08:42.968 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.842350010000001, 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.037019252000000002, 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 301 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.969 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017020+0000", 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2799999999999996e-07 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.970 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017024+0000", 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8039999999999999e-06 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017034+0000", 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0631999999999999e-05 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017043+0000", 2024-09-16T04:08:42.971 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2080000000000006e-06 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017183+0000", 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000140082 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017191+0000", 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2400000000000001e-06 2024-09-16T04:08:42.972 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047641+0000", 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.030450652000000002 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047877+0000", 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000235307 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.973 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.049191+0000", 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013143950000000001 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050617+0000", 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001426306 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.053870+0000", 2024-09-16T04:08:42.974 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032524400000000001 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.054038+0000", 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016855799999999999 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:375 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [append 0~638976] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:08:42.975 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 12.004146457999999, 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.025565072000000001, 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 375 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.977 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855226+0000", 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.23e-06 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858178+0000", 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029523180000000002 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858274+0000", 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6217000000000004e-05 2024-09-16T04:08:42.978 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858302+0000", 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8005999999999999e-05 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858504+0000", 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020172500000000001 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.979 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858809+0000", 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00030490500000000001 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861536+0000", 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027273269999999999 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.980 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867748+0000", 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0062119569999999997 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880622+0000", 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012873648999999999 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880788+0000", 2024-09-16T04:08:42.981 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016573799999999999 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:379 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.990001937000001, 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020566435000000001, 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:42.982 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 379 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:42.983 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869368+0000", 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.034e-06 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869372+0000", 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.984 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869383+0000", 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1143e-05 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869392+0000", 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5569999999999996e-06 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883593+0000", 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014200855 2024-09-16T04:08:42.985 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883796+0000", 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020284599999999999 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.887050+0000", 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032546789999999999 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:42.986 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.887240+0000", 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019004499999999999 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.889934+0000", 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026931429999999998 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:42.987 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:42.989 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:42.985+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:42.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:08:43.015 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:43.016 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:43.037 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:43.060 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:43.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:43.081 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:43.090 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:43.085+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:43.098 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:43.099 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:43.119 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:43.119 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:43.119 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:43.119 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:43.120 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:43.120 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:43.133 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:08:43.142 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:43.142 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:43.163 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:43.164 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:43.183 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:43.183 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:43.191 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:43.189+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:43.205 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:43.205 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:43.230 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:43.230 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:43.250 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:43.250 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:43.251 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:43.251 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:43.251 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:43.251 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:43.251 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:43.265 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:08:43.271 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:43.271 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:43.294 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:43.294 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:43.310 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:43.307+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:43.317 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:43.317 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:43.340 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:43.340 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:43.384 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:43.384 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:43.392 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:43.387+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:43.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:43.493 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:43.487+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:43.534 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:43.534 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:43.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:08:43.594 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:43.591+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:43.675 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:43.675 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:43.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:08:43.695 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:43.692+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:43.796 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:43.790+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:43.814 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:43.814 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:43.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:08:43.866 INFO:tasks.rados.rados.0.smithi204.stdout:189: done (2 left) 2024-09-16T04:08:43.866 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 32 current snap is 15 2024-09-16T04:08:43.866 INFO:tasks.rados.rados.0.smithi204.stdout:190: seq_num 95 ranges {1556480=442368,1998848=540672,2539520=622592} 2024-09-16T04:08:43.896 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:43.893+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:43.901 INFO:tasks.rados.rados.0.smithi204.stdout:190: writing smithi20431790-32 from 1556480 to 1998848 tid 1 2024-09-16T04:08:43.911 INFO:tasks.rados.rados.0.smithi204.stdout:190: writing smithi20431790-32 from 1998848 to 2539520 tid 2 2024-09-16T04:08:43.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-16T04:08:43.921 INFO:tasks.rados.rados.0.smithi204.stdout:190: writing smithi20431790-32 from 2539520 to 3162112 tid 3 2024-09-16T04:08:43.921 INFO:tasks.rados.rados.0.smithi204.stdout:191: read oid 2 snap -1 2024-09-16T04:08:43.921 INFO:tasks.rados.rados.0.smithi204.stdout:191: expect (ObjNum 85 snap 11 seq_num 85) 2024-09-16T04:08:43.921 INFO:tasks.rados.rados.0.smithi204.stdout:192: read oid 45 snap -1 2024-09-16T04:08:43.922 INFO:tasks.rados.rados.0.smithi204.stdout:192: expect (ObjNum 71 snap 4 seq_num 71) 2024-09-16T04:08:43.922 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 24 current snap is 15 2024-09-16T04:08:43.922 INFO:tasks.rados.rados.0.smithi204.stdout:193: seq_num 96 ranges {393216=458752,851968=688128,1540096=475136} 2024-09-16T04:08:43.932 INFO:tasks.rados.rados.0.smithi204.stdout:193: writing smithi20431790-24 from 393216 to 851968 tid 1 2024-09-16T04:08:43.940 INFO:tasks.rados.rados.0.smithi204.stdout:193: writing smithi20431790-24 from 851968 to 1540096 tid 2 2024-09-16T04:08:43.944 INFO:tasks.rados.rados.0.smithi204.stdout:193: writing smithi20431790-24 from 1540096 to 2015232 tid 3 2024-09-16T04:08:43.944 INFO:tasks.rados.rados.0.smithi204.stdout:194: snap_remove snap 10 2024-09-16T04:08:43.973 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:43.973 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:43.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:08:43.997 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:43.992+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:44.098 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:44.097+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:44.111 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:44.111 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:44.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:08:44.214 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:44.213+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:44.294 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:44.294 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:44.300 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:44.297+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:44.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:08:44.401 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:44.394+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:44.477 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:44.477 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:44.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:08:44.502 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:44.496+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:44.603 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:44.600+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:44.619 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:44.619 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:44.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:08:44.704 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:44.700+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:44.761 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:44.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:08:44.805 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:44.802+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:44.840 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-16T04:08:44.845 INFO:tasks.rados.rados.0.smithi204.stdout:194: done (6 left) 2024-09-16T04:08:44.846 INFO:tasks.rados.rados.0.smithi204.stdout:195: copy_from oid 20 from oid 3 current snap is 15 2024-09-16T04:08:44.846 INFO:tasks.rados.rados.0.smithi204.stdout:188: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:44.885 INFO:tasks.rados.rados.0.smithi204.stdout:187: finishing copy_from racing read to smithi20431790-29 2024-09-16T04:08:44.885 INFO:tasks.rados.rados.0.smithi204.stdout:187: finishing copy_from to smithi20431790-29 2024-09-16T04:08:44.885 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 29 v 8 (ObjNum 60 snap 4 seq_num 60) dirty exists 2024-09-16T04:08:44.885 INFO:tasks.rados.rados.0.smithi204.stdout:187: done (6 left) 2024-09-16T04:08:44.885 INFO:tasks.rados.rados.0.smithi204.stdout:188: done (5 left) 2024-09-16T04:08:44.885 INFO:tasks.rados.rados.0.smithi204.stdout:196: snap_remove snap 14 2024-09-16T04:08:44.905 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:44.901+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:44.917 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:44.917 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:44.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:08:45.018 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:45.017+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:45.030 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:08:45.030 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:08:45.030 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-16T04:08:45.030 INFO:tasks.thrashosds.thrasher:Setting osd 8 primary_affinity to 1.000000 2024-09-16T04:08:45.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-09-16T04:08:45.104 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:45.104 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:45.107 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:45.102+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:45.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:08:45.208 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:45.203+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:45.253 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:45.253 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:45.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:08:45.309 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:45.307+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:45.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:45.406 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:45.407 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:45.410 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:45.407+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:45.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:08:45.508 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:45.509 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:45.511 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:45.508+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:45.529 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:45.529 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:45.548 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:45.548 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:45.552 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:45.552 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:45.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:08:45.576 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:45.576 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:45.592 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:45.593 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:45.612 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:45.609+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:45.613 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:45.614 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:45.636 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:45.636 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:45.660 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:45.660 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:45.682 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:45.682 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:45.704 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:45.705 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:45.714 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:45.707+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:45.728 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:45.728 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:45.740 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:45.740 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:45.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.800705026999999, 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080395369999999994, 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936932+0000", 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0530000000000001e-06 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937019+0000", 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7212000000000005e-05 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937052+0000", 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3331000000000003e-05 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937092+0000", 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9437000000000002e-05 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937324+0000", 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023248400000000001 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937349+0000", 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5398e-05 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944874+0000", 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075243269999999999 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944969+0000", 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5295000000000002e-05 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.795733187, 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063272570000000002, 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941903+0000", 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.457e-06 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942075+0000", 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017237900000000001 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942114+0000", 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8433000000000003e-05 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942137+0000", 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3442e-05 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944009+0000", 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018714789999999999 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944031+0000", 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2912e-05 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948133+0000", 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041011930000000004 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948229+0000", 2024-09-16T04:08:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5962e-05 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.795287664, 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059926320000000003, 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942348+0000", 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2300000000000001e-06 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942388+0000", 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0377000000000003e-05 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942419+0000", 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0957000000000002e-05 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942449+0000", 2024-09-16T04:08:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9578e-05 2024-09-16T04:08:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945390+0000", 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029405360000000001 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945413+0000", 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3901999999999999e-05 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948238+0000", 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028249 2024-09-16T04:08:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948339+0000", 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101152 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.7615604, 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064471959999999997, 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976076+0000", 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9429999999999999e-06 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976477+0000", 2024-09-16T04:08:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000400567 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976509+0000", 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2762999999999998e-05 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976533+0000", 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3167999999999999e-05 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976778+0000", 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245324 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976803+0000", 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4780999999999999e-05 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982391+0000", 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055884929999999999 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982521+0000", 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013015699999999999 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.758037001000002, 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072774700000000003, 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979599+0000", 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8530000000000001e-06 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979644+0000", 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4736e-05 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979677+0000", 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2681000000000001e-05 2024-09-16T04:08:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979701+0000", 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3754999999999999e-05 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979867+0000", 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166689 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979890+0000", 2024-09-16T04:08:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3264e-05 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986795+0000", 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069048069999999998 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986875+0000", 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9684999999999993e-05 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.754444618000001, 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076880730000000001, 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983192+0000", 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983586+0000", 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039456700000000002 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983617+0000", 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0574000000000002e-05 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983639+0000", 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2178999999999999e-05 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983866+0000", 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227366 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983888+0000", 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1804e-05 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990760+0000", 2024-09-16T04:08:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068715030000000002 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990878+0000", 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011824600000000001 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=16, reqid=client.4631.0:56, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.752690907000002, 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064676780000000001, 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984946+0000", 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984990+0000", 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3776000000000002e-05 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985022+0000", 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2345999999999998e-05 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985043+0000", 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1549999999999999e-05 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985376+0000", 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033260599999999999 2024-09-16T04:08:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985400+0000", 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4015e-05 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991311+0000", 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059112239999999996 2024-09-16T04:08:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991411+0000", 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010003199999999999 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds1 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.751008296999998, 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059755490000000001, 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986628+0000", 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.905e-06 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986905+0000", 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027719099999999998 2024-09-16T04:08:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986953+0000", 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8182e-05 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986976+0000", 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2997999999999999e-05 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987170+0000", 2024-09-16T04:08:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193217 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987190+0000", 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0588999999999999e-05 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992498+0000", 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053074669999999997 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992602+0000", 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010399999999999999 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.703369886000001, 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062924130000000002, 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034266+0000", 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034464+0000", 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000198808 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034506+0000", 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.197e-05 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034540+0000", 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3098000000000001e-05 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034723+0000", 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018367500000000001 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034753+0000", 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9292e-05 2024-09-16T04:08:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040460+0000", 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057071020000000004 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040557+0000", 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7400999999999998e-05 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.706771709000002, 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061099889999999997, 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030927+0000", 2024-09-16T04:08:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3188999999999994e-05 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030971+0000", 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4634e-05 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030995+0000", 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4032e-05 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031211+0000", 2024-09-16T04:08:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021563299999999999 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031241+0000", 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0329e-05 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036878+0000", 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056365449999999997 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036973+0000", 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5047e-05 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=216, reqid=client.4631.0:301, at_version=0'0, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.681852876000001, 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059219310000000001, 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055784+0000", 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9929999999999998e-06 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055815+0000", 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055858+0000", 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3096999999999998e-05 2024-09-16T04:08:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055879+0000", 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1688999999999999e-05 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056067+0000", 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018760099999999999 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056101+0000", 2024-09-16T04:08:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3775000000000001e-05 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061623+0000", 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055219730000000003 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061704+0000", 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0897999999999997e-05 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.884610202999999, 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058830389999999996, 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853026+0000", 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0899999999999999e-06 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853087+0000", 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0560000000000003e-05 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853119+0000", 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2104999999999998e-05 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853144+0000", 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4912000000000001e-05 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855175+0000", 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002031007 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855211+0000", 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5680999999999999e-05 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858817+0000", 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036060860000000001 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858907+0000", 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0598000000000002e-05 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.884431428999999, 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098485320000000001, 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853204+0000", 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0300000000000001e-06 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853263+0000", 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9006999999999999e-05 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853290+0000", 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6520999999999999e-05 2024-09-16T04:08:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853309+0000", 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9826e-05 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857423+0000", 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041136109999999997 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:08:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1618000000000001e-05 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862892+0000", 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005437491 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863052+0000", 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015942800000000001 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853360+0000", 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.884274505, 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056368060000000003, 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853360+0000", 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853360+0000", 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853361+0000", 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9699999999999994e-07 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853411+0000", 2024-09-16T04:08:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0027000000000001e-05 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853438+0000", 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539000000000001e-05 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853457+0000", 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9491999999999999e-05 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.856113+0000", 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026554590000000002 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.856138+0000", 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5439000000000002e-05 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858918+0000", 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002780228 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858997+0000", 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8625e-05 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.884145181999999, 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069765720000000003, 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853490+0000", 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3699999999999999e-07 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853601+0000", 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111047 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853629+0000", 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7568000000000001e-05 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853648+0000", 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9199e-05 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857263+0000", 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036145560000000001 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857285+0000", 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2382e-05 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860374+0000", 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030894009999999999 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860466+0000", 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1582000000000005e-05 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.881799929, 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072392969999999996, 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855836+0000", 2024-09-16T04:08:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3699999999999999e-07 2024-09-16T04:08:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855889+0000", 2024-09-16T04:08:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.346e-05 2024-09-16T04:08:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855913+0000", 2024-09-16T04:08:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3635e-05 2024-09-16T04:08:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855930+0000", 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7499e-05 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857410+0000", 2024-09-16T04:08:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001480121 2024-09-16T04:08:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857433+0000", 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2582000000000002e-05 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862976+0000", 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055433549999999998 2024-09-16T04:08:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863074+0000", 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7707999999999994e-05 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 54/31 ECSubWrite(tid=254, reqid=osd.11.0:254, at_version=54'19, trim_to=0'0, roll_forward_to=52'17))", 2024-09-16T04:08:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6692698759999995, 2024-09-16T04:08:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078273349999999995, 2024-09-16T04:08:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:08:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6000000000000003e-07 2024-09-16T04:08:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068423+0000", 2024-09-16T04:08:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7707000000000002e-05 2024-09-16T04:08:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068454+0000", 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0882e-05 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068478+0000", 2024-09-16T04:08:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4362000000000002e-05 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068698+0000", 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021970299999999999 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068725+0000", 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7279000000000001e-05 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076089+0000", 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0073640800000000003 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076192+0000", 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102662 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6690649929999992, 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076635829999999999, 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068571+0000", 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1599999999999999e-06 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068645+0000", 2024-09-16T04:08:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4610999999999994e-05 2024-09-16T04:08:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068672+0000", 2024-09-16T04:08:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6710999999999999e-05 2024-09-16T04:08:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068692+0000", 2024-09-16T04:08:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0373e-05 2024-09-16T04:08:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068869+0000", 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017663499999999999 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068896+0000", 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7231999999999999e-05 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076166+0000", 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007269948 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076233+0000", 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6913000000000001e-05 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:08:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:08:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6663421029999999, 2024-09-16T04:08:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074803539999999998, 2024-09-16T04:08:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071293+0000", 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1699999999999998e-07 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071345+0000", 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1811000000000003e-05 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071377+0000", 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2061999999999999e-05 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071404+0000", 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7072000000000001e-05 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071568+0000", 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163609 2024-09-16T04:08:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071626+0000", 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8811000000000003e-05 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078616+0000", 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069891459999999999 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078773+0000", 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157226 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/31 ECSubWrite(tid=214, reqid=client.4631.0:477, at_version=60'108, trim_to=0'0, roll_forward_to=57'102))", 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:42.895042+0000", 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.842592089, 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056113550000000002, 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.895042+0000", 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.895042+0000", 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.895045+0000", 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7599999999999998e-06 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.896083+0000", 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010379709999999999 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.896132+0000", 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9048000000000002e-05 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.896156+0000", 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4298999999999999e-05 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.896324+0000", 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016739000000000001 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.896353+0000", 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8674999999999999e-05 2024-09-16T04:08:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.900596+0000", 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042433009999999997 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:42.900654+0000", 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7911000000000002e-05 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:45.846 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:45.847 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:45.847 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:45.848 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:45.848 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:45.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:08:45.849 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:45.850 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:45.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:45.797+0000 7fc8aa7fc640 0 -- 172.21.15.32:0/4276576869 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7fc8ac2219a0 msgr2=0x7fc8ac223d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:45.851 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:45.842+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:45.894 INFO:tasks.rados.rados.0.smithi204.stdout:196: done (5 left) 2024-09-16T04:08:45.894 INFO:tasks.rados.rados.0.smithi204.stdout:197: rollback oid 16 current snap is 15 2024-09-16T04:08:45.894 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 16 to 13 2024-09-16T04:08:45.894 INFO:tasks.rados.rados.0.smithi204.stdout:190: finishing write tid 1 to smithi20431790-32 2024-09-16T04:08:45.894 INFO:tasks.rados.rados.0.smithi204.stdout:190: finishing write tid 2 to smithi20431790-32 2024-09-16T04:08:45.894 INFO:tasks.rados.rados.0.smithi204.stdout:190: finishing write tid 3 to smithi20431790-32 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: finishing write tid 4 to smithi20431790-32 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: finishing write tid 5 to smithi20431790-32 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: oid 32 updating version 0 to 21 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: oid 32 updating version 21 to 23 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: oid 32 updating version 23 to 24 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: oid 32 version 24 is already newer than 22 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 32 v 24 (ObjNum 95 snap 15 seq_num 95) dirty exists 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:190: left oid 32 (ObjNum 95 snap 15 seq_num 95) 2024-09-16T04:08:45.895 INFO:tasks.rados.rados.0.smithi204.stdout:193: finishing write tid 1 to smithi20431790-24 2024-09-16T04:08:45.896 INFO:tasks.rados.rados.0.smithi204.stdout:191: expect (ObjNum 85 snap 11 seq_num 85) 2024-09-16T04:08:45.896 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-09-16T04:08:45.947 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:45.944+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:45.991 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:45.991 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:45.991 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:45.992 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:46.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:08:46.028 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:46.028 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:46.038 INFO:tasks.rados.rados.0.smithi204.stdout:192: expect (ObjNum 71 snap 4 seq_num 71) 2024-09-16T04:08:46.048 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:46.042+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:46.064 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:46.064 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:46.149 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:46.144+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: finishing write tid 2 to smithi20431790-24 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: finishing write tid 3 to smithi20431790-24 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: finishing write tid 4 to smithi20431790-24 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: finishing write tid 5 to smithi20431790-24 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: oid 24 updating version 0 to 41 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: oid 24 updating version 41 to 42 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: oid 24 version 42 is already newer than 40 2024-09-16T04:08:46.160 INFO:tasks.rados.rados.0.smithi204.stdout:193: oid 24 updating version 42 to 43 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 24 v 43 (ObjNum 96 snap 15 seq_num 96) dirty exists 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:193: left oid 24 (ObjNum 96 snap 15 seq_num 96) 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:195: finishing copy_from to smithi20431790-20 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:195: got expected ENOENT (src dne) 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:195: finishing copy_from racing read to smithi20431790-20 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:197: finishing rollback tid 0 to smithi20431790-16 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:197: finishing rollback tid 1 to smithi20431790-16 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:197: finishing rollback tid 2 to smithi20431790-16 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 16 v 78 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:190: done (5 left) 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:191: done (4 left) 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:192: done (3 left) 2024-09-16T04:08:46.161 INFO:tasks.rados.rados.0.smithi204.stdout:193: done (2 left) 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:195: done (1 left) 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:197: done (0 left) 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:198: read oid 2 snap -1 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:198: expect (ObjNum 85 snap 11 seq_num 85) 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:199: copy_from oid 12 from oid 29 current snap is 15 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:200: rollback oid 4 current snap is 15 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 4 to 13 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:201: rmattr oid 44 current snap is 15 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:201: done (3 left) 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:202: read oid 9 snap -1 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:202: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 19 current snap is 15 2024-09-16T04:08:46.162 INFO:tasks.rados.rados.0.smithi204.stdout:203: seq_num 97 ranges {458752=475136,933888=442368,1376256=442368,1818624=278528} 2024-09-16T04:08:46.174 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:46.175 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:46.177 INFO:tasks.rados.rados.0.smithi204.stdout:203: writing smithi20431790-19 from 458752 to 933888 tid 1 2024-09-16T04:08:46.185 INFO:tasks.rados.rados.0.smithi204.stdout:203: writing smithi20431790-19 from 933888 to 1376256 tid 2 2024-09-16T04:08:46.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:08:46.194 INFO:tasks.rados.rados.0.smithi204.stdout:203: writing smithi20431790-19 from 1376256 to 1818624 tid 3 2024-09-16T04:08:46.199 INFO:tasks.rados.rados.0.smithi204.stdout:203: writing smithi20431790-19 from 1818624 to 2097152 tid 4 2024-09-16T04:08:46.199 INFO:tasks.rados.rados.0.smithi204.stdout:204: copy_from oid 18 from oid 10 current snap is 15 2024-09-16T04:08:46.199 INFO:tasks.rados.rados.0.smithi204.stdout:200: finishing rollback tid 0 to smithi20431790-4 2024-09-16T04:08:46.199 INFO:tasks.rados.rados.0.smithi204.stdout:200: finishing rollback tid 1 to smithi20431790-4 2024-09-16T04:08:46.199 INFO:tasks.rados.rados.0.smithi204.stdout:202: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:46.213 INFO:tasks.rados.rados.0.smithi204.stdout:200: finishing rollback tid 2 to smithi20431790-4 2024-09-16T04:08:46.213 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 4 v 63 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-16T04:08:46.213 INFO:tasks.rados.rados.0.smithi204.stdout:199: finishing copy_from racing read to smithi20431790-12 2024-09-16T04:08:46.214 INFO:tasks.rados.rados.0.smithi204.stdout:199: finishing copy_from to smithi20431790-12 2024-09-16T04:08:46.214 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 12 v 8 (ObjNum 60 snap 4 seq_num 60) dirty exists 2024-09-16T04:08:46.214 INFO:tasks.rados.rados.0.smithi204.stdout:198: expect (ObjNum 85 snap 11 seq_num 85) 2024-09-16T04:08:46.250 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:46.245+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:46.344 INFO:tasks.rados.rados.0.smithi204.stdout:203: finishing write tid 1 to smithi20431790-19 2024-09-16T04:08:46.344 INFO:tasks.rados.rados.0.smithi204.stdout:203: finishing write tid 2 to smithi20431790-19 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: finishing write tid 3 to smithi20431790-19 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: finishing write tid 4 to smithi20431790-19 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: finishing write tid 5 to smithi20431790-19 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:204: finishing copy_from racing read to smithi20431790-18 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:204: finishing copy_from to smithi20431790-18 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 18 v 6 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: finishing write tid 6 to smithi20431790-19 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: oid 19 updating version 0 to 138 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: oid 19 version 138 is already newer than 137 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: oid 19 version 138 is already newer than 136 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: oid 19 version 138 is already newer than 135 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: oid 19 version 138 is already newer than 134 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 19 v 138 (ObjNum 97 snap 15 seq_num 97) dirty exists 2024-09-16T04:08:46.345 INFO:tasks.rados.rados.0.smithi204.stdout:203: left oid 19 (ObjNum 97 snap 15 seq_num 97) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:198: done (5 left) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:199: done (4 left) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:200: done (3 left) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:202: done (2 left) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:203: done (1 left) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:204: done (0 left) 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 8 current snap is 15 2024-09-16T04:08:46.346 INFO:tasks.rados.rados.0.smithi204.stdout:205: seq_num 98 ranges {999424=491520,1490944=589824,2080768=557056,2637824=16384} 2024-09-16T04:08:46.351 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:46.348+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:34 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~196608,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.412890468000001, 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023419893000000001, 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 34 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949751+0000", 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3790000000000002e-06 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951559+0000", 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018085589999999999 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951588+0000", 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8728e-05 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951607+0000", 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8817999999999998e-05 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951866+0000", 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025890800000000002 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952244+0000", 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378222 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.954553+0000", 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023090099999999998 2024-09-16T04:08:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961470+0000", 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069174079999999999 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972971+0000", 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011500923999999999 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973167+0000", 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195937 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:35 3.cs0 3:3ee250f2:::smithi20431790-12:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.410980137999999, 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.029134334000000001, 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 35 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951660+0000", 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.176e-06 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951673+0000", 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2799000000000001e-05 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951697+0000", 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4698e-05 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951715+0000", 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7265000000000002e-05 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957234+0000", 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055191260000000001 2024-09-16T04:08:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957565+0000", 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033102199999999999 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960023+0000", 2024-09-16T04:08:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002458567 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.963486+0000", 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034622020000000002 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980404+0000", 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016918914 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980792+0000", 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038756499999999998 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:36 3.cs0 3:3ee250f2:::smithi20431790-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.410897572, 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.045222315999999999, 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 36 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:08:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951742+0000", 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951749+0000", 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7190000000000001e-06 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951770+0000", 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0092e-05 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951785+0000", 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5162e-05 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961177+0000", 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093920979999999998 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961445+0000", 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268664 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981947+0000", 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020501287999999999 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982122+0000", 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017487899999999999 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996963+0000", 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014840901 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:49 3.5s0 3:a07911e0:::smithi20431790-17:head [append 0~278528,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.398223575999999, 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017107101999999999, 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 49 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964417+0000", 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0529999999999998e-06 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964962+0000", 2024-09-16T04:08:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054521099999999998 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964997+0000", 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4028e-05 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965020+0000", 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3553999999999998e-05 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965225+0000", 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020534700000000001 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965562+0000", 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000336332 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967943+0000", 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023810950000000002 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971887+0000", 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039443120000000002 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981336+0000", 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0094491490000000004 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981521+0000", 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000185021 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:50 3.5s0 3:a07911e0:::smithi20431790-17:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.397536783, 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018470364999999999, 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 50 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965103+0000", 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965114+0000", 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1616e-05 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965139+0000", 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4711000000000001e-05 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965158+0000", 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8774999999999999e-05 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969089+0000", 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039314490000000001 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969306+0000", 2024-09-16T04:08:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021679300000000001 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.970337+0000", 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001030385 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974758+0000", 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044213810000000003 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983346+0000", 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085879849999999994 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983571+0000", 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225427 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:51 3.5s0 3:a07911e0:::smithi20431790-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:08:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.397443217999999, 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022912589000000001, 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 51 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965196+0000", 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5e-06 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965204+0000", 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965227+0000", 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2751e-05 2024-09-16T04:08:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965247+0000", 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0404999999999999e-05 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971064+0000", 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058171619999999999 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971306+0000", 2024-09-16T04:08:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024202800000000001 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984390+0000", 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013083734 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984580+0000", 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000190101 2024-09-16T04:08:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988107+0000", 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035270050000000002 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:70 3.cs0 3:32f692e4:::smithi20431790-24:head [append 0~393216,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.378168485, 2024-09-16T04:08:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022625648000000002, 2024-09-16T04:08:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 70 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984472+0000", 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5770000000000001e-06 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985137+0000", 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066504699999999999 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985170+0000", 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2877999999999999e-05 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985193+0000", 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3014999999999999e-05 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988812+0000", 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003619583 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989134+0000", 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000321496 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992649+0000", 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003514994 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997670+0000", 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050209540000000002 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006922+0000", 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092525839999999995 2024-09-16T04:08:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007095+0000", 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017252000000000001 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:71 3.cs0 3:32f692e4:::smithi20431790-24:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.377407931, 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024343912999999998, 2024-09-16T04:08:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 71 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985232+0000", 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7710000000000001e-06 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985241+0000", 2024-09-16T04:08:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985269+0000", 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7426000000000001e-05 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985286+0000", 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994404+0000", 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.009118279 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994605+0000", 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020087800000000001 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995926+0000", 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013212320000000001 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998575+0000", 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026493300000000001 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009408+0000", 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010832965999999999 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009574+0000", 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165487 2024-09-16T04:08:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:72 3.cs0 3:32f692e4:::smithi20431790-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.377327788999999, 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030489715000000001, 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 72 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985311+0000", 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.234e-06 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985319+0000", 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8110000000000003e-06 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985338+0000", 2024-09-16T04:08:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9372e-05 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985354+0000", 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997327+0000", 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011973477999999999 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997539+0000", 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021212 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010366+0000", 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012826743 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010517+0000", 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150987 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015800+0000", 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052827170000000001 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:79 3.5s0 3:a92fec0c:::smithi20431790-27:head [append 0~442368,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.369420100999999, 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022443769999999998, 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 79 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993221+0000", 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1939999999999998e-06 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994063+0000", 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000842401 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994096+0000", 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2977e-05 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994117+0000", 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0632000000000002e-05 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994356+0000", 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023911000000000001 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994668+0000", 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031195700000000002 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998787+0000", 2024-09-16T04:08:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041189850000000004 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004001+0000", 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052138510000000002 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015531+0000", 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011530004 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015661+0000", 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013065900000000001 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:80 3.5s0 3:a92fec0c:::smithi20431790-27:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.368465277999999, 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022213561999999999, 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 80 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994174+0000", 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6190000000000001e-06 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994185+0000", 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1014e-05 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994208+0000", 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2677999999999999e-05 2024-09-16T04:08:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994225+0000", 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7238e-05 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001985+0000", 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077595709999999998 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002157+0000", 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017256300000000001 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003005+0000", 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084732500000000001 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004682+0000", 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016769899999999999 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016279+0000", 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011597303 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016386+0000", 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107261 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:81 3.5s0 3:a92fec0c:::smithi20431790-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.368150091, 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025428882, 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 81 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994490+0000", 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:08:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994499+0000", 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6420000000000002e-06 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994529+0000", 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9405999999999999e-05 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994548+0000", 2024-09-16T04:08:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9884000000000001e-05 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004211+0000", 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0096627850000000001 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004368+0000", 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015635099999999999 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016915+0000", 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012547063000000001 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.017089+0000", 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017398399999999999 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.019917+0000", 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028279239999999999 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:302 3.cs0 3:374a82ae:::smithi20431790-44:head [append 0~475136] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.328564302, 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018500445000000001, 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 302 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034077+0000", 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2820000000000001e-06 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038863+0000", 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047866250000000001 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038897+0000", 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3225000000000001e-05 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038915+0000", 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8802000000000001e-05 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.039123+0000", 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000207641 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.039359+0000", 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023585199999999999 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.041836+0000", 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024766670000000001 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046352+0000", 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045161610000000003 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052364+0000", 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060125530000000003 2024-09-16T04:08:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052574+0000", 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020963700000000001 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:303 3.cs0 3:374a82ae:::smithi20431790-44:head [append 0~622592] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.042256+0000", 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.320381297000001, 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016383529000000001, 2024-09-16T04:08:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 303 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.042256+0000", 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.042256+0000", 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.042259+0000", 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046266+0000", 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004007109 2024-09-16T04:08:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046329+0000", 2024-09-16T04:08:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2849999999999996e-05 2024-09-16T04:08:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046351+0000", 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1784999999999999e-05 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047300+0000", 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094923499999999999 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047551+0000", 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025068099999999999 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.049996+0000", 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457429999999998 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.057627+0000", 2024-09-16T04:08:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076302389999999996 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.058449+0000", 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00082214899999999999 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.058640+0000", 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000191368 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:304 3.cs0 3:374a82ae:::smithi20431790-44:head [append 0~147456] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.047014+0000", 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.315624163999999, 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014254490999999999, 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 304 2024-09-16T04:08:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047014+0000", 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047014+0000", 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047016+0000", 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3989999999999998e-06 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047288+0000", 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027247399999999998 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047320+0000", 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1581000000000001e-05 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047341+0000", 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1069000000000001e-05 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052832+0000", 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054907280000000003 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.053072+0000", 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024004500000000001 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.054534+0000", 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014618439999999999 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.057761+0000", 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032270240000000002 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061066+0000", 2024-09-16T04:08:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003304736 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061268+0000", 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020259100000000001 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:305 3.cs0 3:374a82ae:::smithi20431790-44:head [setxattr _header (56) in=7b] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.047379+0000", 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.315258913000001, 2024-09-16T04:08:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016356613999999998, 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 305 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047379+0000", 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047379+0000", 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047380+0000", 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3030000000000001e-06 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047387+0000", 2024-09-16T04:08:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7889999999999997e-06 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047402+0000", 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5026e-05 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047414+0000", 2024-09-16T04:08:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.171e-05 2024-09-16T04:08:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055634+0000", 2024-09-16T04:08:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0082204689999999993 2024-09-16T04:08:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055900+0000", 2024-09-16T04:08:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026556799999999999 2024-09-16T04:08:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.057092+0000", 2024-09-16T04:08:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001192636 2024-09-16T04:08:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.059653+0000", 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025602120000000001 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063525+0000", 2024-09-16T04:08:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038721179999999999 2024-09-16T04:08:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063735+0000", 2024-09-16T04:08:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000210783 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:306 3.cs0 3:374a82ae:::smithi20431790-44:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:08:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.315202217, 2024-09-16T04:08:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026506662, 2024-09-16T04:08:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 306 2024-09-16T04:08:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047437+0000", 2024-09-16T04:08:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-16T04:08:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047443+0000", 2024-09-16T04:08:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.426e-06 2024-09-16T04:08:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047463+0000", 2024-09-16T04:08:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0193000000000001e-05 2024-09-16T04:08:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047473+0000", 2024-09-16T04:08:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3689999999999996e-06 2024-09-16T04:08:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063090+0000", 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617617 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063269+0000", 2024-09-16T04:08:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017882900000000001 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064581+0000", 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001311986 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064808+0000", 2024-09-16T04:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022633899999999999 2024-09-16T04:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.073942+0000", 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091346529999999995 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:380 3.5s0 3:a07911e0:::smithi20431790-17:head [stat,delete] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:08:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.867354+0000", 2024-09-16T04:08:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.495283579000001, 2024-09-16T04:08:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013151837, 2024-09-16T04:08:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 380 2024-09-16T04:08:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867354+0000", 2024-09-16T04:08:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867354+0000", 2024-09-16T04:08:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867357+0000", 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5129999999999999e-06 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867372+0000", 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4949e-05 2024-09-16T04:08:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867405+0000", 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2975000000000002e-05 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867425+0000", 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0599e-05 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867686+0000", 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026028899999999997 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.867971+0000", 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028549100000000002 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.869995+0000", 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020238069999999999 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.876139+0000", 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061436809999999998 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.880311+0000", 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041726949999999997 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.880506+0000", 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019483799999999999 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:468 3.cs0 3:3ee250f2:::smithi20431790-12:head [rollback a] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852779+0000", 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5098588150000003, 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013669410999999999, 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 468 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852779+0000", 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852779+0000", 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852780+0000", 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0100000000000001e-06 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852785+0000", 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2569999999999998e-06 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852805+0000", 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9726000000000001e-05 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852821+0000", 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6178999999999999e-05 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.856918+0000", 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040965460000000004 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.857081+0000", 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016313300000000001 2024-09-16T04:08:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.858641+0000", 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015601720000000001 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864073+0000", 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054323069999999999 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866258+0000", 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021849080000000002 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866448+0000", 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000190173 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:469 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.509759259, 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016802089999999999, 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 469 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852880+0000", 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852891+0000", 2024-09-16T04:08:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1263e-05 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852917+0000", 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5423e-05 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852934+0000", 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7062e-05 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859376+0000", 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064419810000000003 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859639+0000", 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026322599999999998 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861937+0000", 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022980449999999999 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864439+0000", 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025016249999999999 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869468+0000", 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050291470000000003 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869681+0000", 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285799999999999 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:46.496 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:46.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:205: writing smithi20431790-8 from 999424 to 1490944 tid 1 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:205: writing smithi20431790-8 from 1490944 to 2080768 tid 2 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:205: writing smithi20431790-8 from 2080768 to 2637824 tid 3 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:205: writing smithi20431790-8 from 2637824 to 2654208 tid 4 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:206: read oid 9 snap -1 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:206: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:207: rollback oid 22 current snap is 15 2024-09-16T04:08:46.499 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 22 to 13 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:205: finishing write tid 1 to smithi20431790-8 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:205: finishing write tid 2 to smithi20431790-8 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:208: delete oid 23 current snap is 15 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:206: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:207: finishing rollback tid 0 to smithi20431790-22 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:207: finishing rollback tid 1 to smithi20431790-22 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:207: finishing rollback tid 2 to smithi20431790-22 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 22 v 46 (ObjNum 79 snap 7 seq_num 79) dirty exists 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:206: done (3 left) 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:207: done (2 left) 2024-09-16T04:08:46.500 INFO:tasks.rados.rados.0.smithi204.stdout:208: done (1 left) 2024-09-16T04:08:46.501 INFO:tasks.rados.rados.0.smithi204.stdout:209: snap_remove snap 13 2024-09-16T04:08:46.501 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:46.493+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:46.599 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:46.595+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:46.675 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:46.676 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:46.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:08:46.735 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:46.732+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:46.800 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:46.796+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:46.815 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:46.816 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:46.816 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:46.816 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:46.816 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:46.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:08:46.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-16T04:08:46.908 INFO:tasks.rados.rados.0.smithi204.stdout:209: done (1 left) 2024-09-16T04:08:46.908 INFO:tasks.rados.rados.0.smithi204.stdout:210: read oid 35 snap -1 2024-09-16T04:08:46.908 INFO:tasks.rados.rados.0.smithi204.stdout:210: expect (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:46.908 INFO:tasks.rados.rados.0.smithi204.stdout:211: copy_from oid 4 from oid 16 current snap is 15 2024-09-16T04:08:46.908 INFO:tasks.rados.rados.0.smithi204.stdout:205: finishing write tid 3 to smithi20431790-8 2024-09-16T04:08:46.909 INFO:tasks.rados.rados.0.smithi204.stdout:205: finishing write tid 4 to smithi20431790-8 2024-09-16T04:08:46.909 INFO:tasks.rados.rados.0.smithi204.stdout:205: finishing write tid 5 to smithi20431790-8 2024-09-16T04:08:46.909 INFO:tasks.rados.rados.0.smithi204.stdout:205: finishing write tid 6 to smithi20431790-8 2024-09-16T04:08:46.909 INFO:tasks.rados.rados.0.smithi204.stdout:205: oid 8 updating version 0 to 82 2024-09-16T04:08:46.909 INFO:tasks.rados.rados.0.smithi204.stdout:205: oid 8 updating version 82 to 83 2024-09-16T04:08:46.909 INFO:tasks.rados.rados.0.smithi204.stdout:205: oid 8 version 83 is already newer than 81 2024-09-16T04:08:46.910 INFO:tasks.rados.rados.0.smithi204.stdout:205: oid 8 version 83 is already newer than 80 2024-09-16T04:08:46.910 INFO:tasks.rados.rados.0.smithi204.stdout:205: oid 8 updating version 83 to 84 2024-09-16T04:08:46.910 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 8 v 84 (ObjNum 98 snap 15 seq_num 98) dirty exists 2024-09-16T04:08:46.910 INFO:tasks.rados.rados.0.smithi204.stdout:205: left oid 8 (ObjNum 98 snap 15 seq_num 98) 2024-09-16T04:08:46.911 INFO:tasks.rados.rados.0.smithi204.stdout:205: done (2 left) 2024-09-16T04:08:46.911 INFO:tasks.rados.rados.0.smithi204.stdout:212: rollback oid 41 current snap is 15 2024-09-16T04:08:46.911 INFO:tasks.rados.rados.0.smithi204.stdout:212: done (2 left) 2024-09-16T04:08:46.911 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 30 current snap is 15 2024-09-16T04:08:46.911 INFO:tasks.rados.rados.0.smithi204.stdout:213: seq_num 100 ranges {4128768=524288,4653056=753664,5406720=409600} 2024-09-16T04:08:46.915 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:46.912+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:46.981 INFO:tasks.rados.rados.0.smithi204.stdout:213: writing smithi20431790-30 from 4128768 to 4653056 tid 1 2024-09-16T04:08:46.983 INFO:tasks.rados.rados.0.smithi204.stdout:213: writing smithi20431790-30 from 4653056 to 5406720 tid 2 2024-09-16T04:08:46.987 INFO:tasks.rados.rados.0.smithi204.stdout:213: writing smithi20431790-30 from 5406720 to 5816320 tid 3 2024-09-16T04:08:46.987 INFO:tasks.rados.rados.0.smithi204.stdout:214: read oid 17 snap -1 2024-09-16T04:08:46.987 INFO:tasks.rados.rados.0.smithi204.stdout:214: expect deleted 2024-09-16T04:08:46.987 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 2 current snap is 15 2024-09-16T04:08:46.987 INFO:tasks.rados.rados.0.smithi204.stdout:215: seq_num 101 ranges {2637824=540672,3178496=507904,3686400=622592,4308992=32768} 2024-09-16T04:08:47.002 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:46.998+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:47.010 INFO:tasks.rados.rados.0.smithi204.stdout:215: writing smithi20431790-2 from 2637824 to 3178496 tid 1 2024-09-16T04:08:47.014 INFO:tasks.rados.rados.0.smithi204.stdout:215: writing smithi20431790-2 from 3178496 to 3686400 tid 2 2024-09-16T04:08:47.018 INFO:tasks.rados.rados.0.smithi204.stdout:215: writing smithi20431790-2 from 3686400 to 4308992 tid 3 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:08:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.076952157000001, 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063652539999999999, 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938469+0000", 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2699999999999998e-07 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938635+0000", 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016581300000000001 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938684+0000", 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9576000000000001e-05 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938883+0000", 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000199173 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939095+0000", 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000211246 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939119+0000", 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4357000000000001e-05 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944738+0000", 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056193900000000001 2024-09-16T04:08:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944833+0000", 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4871999999999996e-05 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.076412834999999, 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047666380000000001, 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939008+0000", 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.13e-07 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939093+0000", 2024-09-16T04:08:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5012999999999994e-05 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939129+0000", 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5636999999999998e-05 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939152+0000", 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3745000000000001e-05 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939447+0000", 2024-09-16T04:08:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029490799999999998 2024-09-16T04:08:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939469+0000", 2024-09-16T04:08:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1848000000000002e-05 2024-09-16T04:08:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943713+0000", 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042438789999999999 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943774+0000", 2024-09-16T04:08:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0995000000000001e-05 2024-09-16T04:08:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:08:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.076332852, 2024-09-16T04:08:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058140029999999999, 2024-09-16T04:08:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939089+0000", 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5570000000000001e-06 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939159+0000", 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0069999999999998e-05 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939189+0000", 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9971000000000002e-05 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939212+0000", 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3088999999999999e-05 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941350+0000", 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021383169999999998 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941374+0000", 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3742000000000001e-05 2024-09-16T04:08:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944842+0000", 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034683349999999999 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944901+0000", 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8922000000000003e-05 2024-09-16T04:08:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.073272715000002, 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050280460000000004, 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:08:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942149+0000", 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-06 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942191+0000", 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1461999999999997e-05 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942224+0000", 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3181e-05 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942254+0000", 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0151e-05 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942467+0000", 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212862 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942490+0000", 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3227999999999999e-05 2024-09-16T04:08:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947072+0000", 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00458203 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947176+0000", 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010343799999999999 2024-09-16T04:08:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=2, reqid=client.4631.0:49, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.967594+0000", 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.047826017999999, 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046403140000000004, 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967594+0000", 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967594+0000", 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967595+0000", 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967979+0000", 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038433800000000002 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968297+0000", 2024-09-16T04:08:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031739700000000002 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968329+0000", 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2724e-05 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968501+0000", 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017191600000000001 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968523+0000", 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2211000000000001e-05 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972141+0000", 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036174800000000002 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972235+0000", 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3554999999999995e-05 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=4, reqid=client.4631.0:52, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.968600+0000", 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.046820049000001, 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043334439999999997, 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968600+0000", 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968600+0000", 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968602+0000", 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0099999999999998e-06 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968790+0000", 2024-09-16T04:08:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000187944 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968824+0000", 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3884000000000003e-05 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.968848+0000", 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4000999999999999e-05 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969085+0000", 2024-09-16T04:08:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023667100000000001 2024-09-16T04:08:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969110+0000", 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5361e-05 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972839+0000", 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037292139999999998 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972934+0000", 2024-09-16T04:08:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4358999999999996e-05 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976401+0000", 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.039019490000001, 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046894420000000003, 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976401+0000", 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976401+0000", 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976403+0000", 2024-09-16T04:08:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9709999999999998e-06 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976629+0000", 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022586399999999999 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976661+0000", 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2796999999999998e-05 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976683+0000", 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1219000000000001e-05 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976817+0000", 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013438 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976840+0000", 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2789000000000002e-05 2024-09-16T04:08:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980995+0000", 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00415527 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981090+0000", 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5152e-05 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=8, reqid=client.4631.0:61, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:08:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.037957909999999, 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063833630000000004, 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:08:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977464+0000", 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.531e-06 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977708+0000", 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024464000000000002 2024-09-16T04:08:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977740+0000", 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1711000000000002e-05 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977762+0000", 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399e-05 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977934+0000", 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000172654 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977956+0000", 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1435000000000001e-05 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983751+0000", 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057949120000000002 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983846+0000", 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5081000000000007e-05 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=9, reqid=client.4631.0:62, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.037167798999999, 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056761249999999997, 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978254+0000", 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.488e-06 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978292+0000", 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7880000000000003e-05 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978321+0000", 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9023e-05 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978340+0000", 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9524000000000001e-05 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979207+0000", 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00086708800000000002 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979243+0000", 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5457000000000003e-05 2024-09-16T04:08:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983860+0000", 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046170930000000001 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983929+0000", 2024-09-16T04:08:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8571999999999993e-05 2024-09-16T04:08:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=6, reqid=client.4631.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.031391997, 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011901461, 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984031+0000", 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3429999999999998e-06 2024-09-16T04:08:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984058+0000", 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7029000000000002e-05 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984089+0000", 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1016999999999998e-05 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984109+0000", 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0842000000000001e-05 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984406+0000", 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029609200000000002 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984434+0000", 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8918e-05 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995793+0000", 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011358052 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995930+0000", 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013716800000000001 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.029001744999999, 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095992419999999992, 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986420+0000", 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.934e-06 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987321+0000", 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090024099999999998 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987354+0000", 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3154999999999997e-05 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987376+0000", 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1923999999999999e-05 2024-09-16T04:08:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987514+0000", 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013814799999999999 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987534+0000", 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9873000000000001e-05 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995938+0000", 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084043529999999998 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996018+0000", 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9614e-05 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.025374275000001, 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059765189999999996, 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:08:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:08:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990048+0000", 2024-09-16T04:08:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8509999999999999e-06 2024-09-16T04:08:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990075+0000", 2024-09-16T04:08:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7158e-05 2024-09-16T04:08:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990106+0000", 2024-09-16T04:08:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1080000000000001e-05 2024-09-16T04:08:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990136+0000", 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9901000000000001e-05 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990290+0000", 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015433800000000001 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990314+0000", 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3421000000000002e-05 2024-09-16T04:08:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995910+0000", 2024-09-16T04:08:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055967500000000002 2024-09-16T04:08:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996022+0000", 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011202 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 34/31 ECSubWrite(tid=14, reqid=client.4631.0:68, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992455+0000", 2024-09-16T04:08:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.022965282000001, 2024-09-16T04:08:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044737860000000004, 2024-09-16T04:08:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992455+0000", 2024-09-16T04:08:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992455+0000", 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992457+0000", 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.885e-06 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992512+0000", 2024-09-16T04:08:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5535999999999998e-05 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992570+0000", 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7886000000000001e-05 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992600+0000", 2024-09-16T04:08:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9889000000000001e-05 2024-09-16T04:08:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992769+0000", 2024-09-16T04:08:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000169116 2024-09-16T04:08:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992792+0000", 2024-09-16T04:08:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2484e-05 2024-09-16T04:08:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996824+0000", 2024-09-16T04:08:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004032384 2024-09-16T04:08:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996929+0000", 2024-09-16T04:08:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010460599999999999 2024-09-16T04:08:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992655+0000", 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.022765322000001, 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043788179999999996, 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992655+0000", 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992655+0000", 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992656+0000", 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7699999999999992e-07 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993378+0000", 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00072215699999999996 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993408+0000", 2024-09-16T04:08:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0297000000000001e-05 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993428+0000", 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0092999999999999e-05 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993637+0000", 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020855799999999999 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993681+0000", 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4058999999999999e-05 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996938+0000", 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032569370000000001 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997034+0000", 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5740000000000002e-05 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 38/31 ECSubWrite(tid=32, reqid=client.4631.0:186, at_version=38'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 26.041492574999999, 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048151569999999996, 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6599999999999996e-07 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973995+0000", 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6209000000000003e-05 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974069+0000", 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4597000000000004e-05 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974094+0000", 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4532000000000002e-05 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974684+0000", 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058996600000000004 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974697+0000", 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3689000000000001e-05 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.977292+0000", 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025942180000000001 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.978743+0000", 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014512800000000001 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.161589662000001, 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074691879999999999, 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853882+0000", 2024-09-16T04:08:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0699999999999999e-05 2024-09-16T04:08:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853914+0000", 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1569000000000002e-05 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853935+0000", 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1818e-05 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.854184+0000", 2024-09-16T04:08:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024827300000000003 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.854210+0000", 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5885e-05 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.861170+0000", 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069599529999999996 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.861300+0000", 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013018599999999999 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.0s2 53/31 ECSubWrite(tid=66, reqid=client.4631.0:413, at_version=53'27, trim_to=0'0, roll_forward_to=52'25))", 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.945712889999999, 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053210929999999998, 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069708+0000", 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0699999999999997e-07 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070037+0000", 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032869699999999997 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070073+0000", 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6288000000000002e-05 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070098+0000", 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5075999999999998e-05 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070299+0000", 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020064 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070326+0000", 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7291999999999999e-05 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.074948+0000", 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046217669999999997 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.075028+0000", 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0725999999999999e-05 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 54/31 ECSubWrite(tid=73, reqid=osd.5.0:73, at_version=54'16, trim_to=0'0, roll_forward_to=52'14))", 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.076751+0000", 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9386691280000008, 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045397780000000004, 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076751+0000", 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076751+0000", 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076752+0000", 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9400000000000005e-07 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076803+0000", 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1387000000000001e-05 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076831+0000", 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8402e-05 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076859+0000", 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7132e-05 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.077358+0000", 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00049927000000000001 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.077383+0000", 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4678999999999999e-05 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.081194+0000", 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003811755 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.081291+0000", 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6558999999999995e-05 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 54/31 ECSubWrite(tid=100, reqid=osd.13.0:98, at_version=0'0, trim_to=0'0, roll_forward_to=54'9))", 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.087859+0000", 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9275611569999995, 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045218530000000002, 2024-09-16T04:08:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.087859+0000", 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.087859+0000", 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.087861+0000", 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0169999999999999e-06 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.087889+0000", 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8331999999999999e-05 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.087937+0000", 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7864000000000001e-05 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.087961+0000", 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4012e-05 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.088200+0000", 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000238316 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.088226+0000", 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6081999999999999e-05 2024-09-16T04:08:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.092287+0000", 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040613869999999996 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.092381+0000", 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3843000000000003e-05 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=104, reqid=client.4631.0:475, at_version=59'34, trim_to=0'0, roll_forward_to=52'32))", 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1547632050000001, 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056955520000000004, 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860658+0000", 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860757+0000", 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9046e-05 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860802+0000", 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4814999999999997e-05 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860829+0000", 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7495e-05 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861131+0000", 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030179099999999998 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861164+0000", 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3538999999999999e-05 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866258+0000", 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050931470000000001 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866353+0000", 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5025999999999994e-05 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.141 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:47.142 INFO:tasks.rados.rados.0.smithi204.stdout:215: writing smithi20431790-2 from 4308992 to 4341760 tid 4 2024-09-16T04:08:47.142 INFO:tasks.rados.rados.0.smithi204.stdout:216: delete oid 28 current snap is 15 2024-09-16T04:08:47.142 INFO:tasks.rados.rados.0.smithi204.stdout:210: expect (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:211: finishing copy_from racing read to smithi20431790-4 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:211: finishing copy_from to smithi20431790-4 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 4 v 78 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: finishing write tid 1 to smithi20431790-30 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: finishing write tid 2 to smithi20431790-30 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: finishing write tid 3 to smithi20431790-30 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: finishing write tid 4 to smithi20431790-30 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: finishing write tid 5 to smithi20431790-30 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: oid 30 updating version 0 to 146 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: oid 30 version 146 is already newer than 143 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: oid 30 version 146 is already newer than 145 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:213: oid 30 version 146 is already newer than 144 2024-09-16T04:08:47.143 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 146 (ObjNum 100 snap 15 seq_num 100) dirty exists 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:213: left oid 30 (ObjNum 100 snap 15 seq_num 100) 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: finishing write tid 1 to smithi20431790-2 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:210: done (5 left) 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:211: done (4 left) 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:213: done (3 left) 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:214: done (2 left) 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:216: done (1 left) 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:217: snap_create 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: finishing write tid 2 to smithi20431790-2 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: finishing write tid 3 to smithi20431790-2 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: finishing write tid 4 to smithi20431790-2 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: finishing write tid 5 to smithi20431790-2 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: finishing write tid 6 to smithi20431790-2 2024-09-16T04:08:47.144 INFO:tasks.rados.rados.0.smithi204.stdout:215: oid 2 updating version 0 to 38 2024-09-16T04:08:47.145 INFO:tasks.rados.rados.0.smithi204.stdout:215: oid 2 version 38 is already newer than 37 2024-09-16T04:08:47.145 INFO:tasks.rados.rados.0.smithi204.stdout:215: oid 2 version 38 is already newer than 36 2024-09-16T04:08:47.145 INFO:tasks.rados.rados.0.smithi204.stdout:215: oid 2 updating version 38 to 39 2024-09-16T04:08:47.145 INFO:tasks.rados.rados.0.smithi204.stdout:215: oid 2 updating version 39 to 40 2024-09-16T04:08:47.145 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 2 v 40 (ObjNum 101 snap 15 seq_num 101) dirty exists 2024-09-16T04:08:47.145 INFO:tasks.rados.rados.0.smithi204.stdout:215: left oid 2 (ObjNum 101 snap 15 seq_num 101) 2024-09-16T04:08:47.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:08:47.147 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:47.145+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:47.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:47.233+0000 7f8241f7f640 0 --2- 172.21.15.32:0/3943902461 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8228003a10 0x7f823c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T04:08:47.247 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:47.244+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:47.325 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:47.325 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:47.325 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:08:47.325 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:47.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:08:47.348 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:47.347+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:47.449 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:47.444+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:47.512 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:08:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:08:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:08:47.512 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:47.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:08:47.550 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:47.546+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:47.651 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:47.647+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:9 3.as0 3:52d8912d:::smithi20431790-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.761076189000001, 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.032735913999999998, 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 9 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934092+0000", 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3170000000000001e-06 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934099+0000", 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.37e-06 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934121+0000", 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2124999999999999e-05 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934137+0000", 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6464999999999999e-05 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941032+0000", 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068944719999999996 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941265+0000", 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233105 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952818+0000", 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011552529000000001 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.953039+0000", 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221089 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.966827+0000", 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013788442 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:19 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~114688,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.757789086999999, 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019793136999999999, 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 19 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937378+0000", 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937381+0000", 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.633e-06 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937660+0000", 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027928000000000002 2024-09-16T04:08:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5524000000000001e-05 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937718+0000", 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2602000000000001e-05 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937890+0000", 2024-09-16T04:08:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017148200000000001 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938217+0000", 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032706899999999998 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.940124+0000", 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001907143 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948870+0000", 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087458320000000003 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.956986+0000", 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0081158810000000001 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957171+0000", 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018569100000000001 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:20 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.756565542000001, 2024-09-16T04:08:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020600382, 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 20 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938604+0000", 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9659999999999999e-06 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938616+0000", 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1992e-05 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938643+0000", 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7447999999999999e-05 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9269000000000001e-05 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941338+0000", 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002675242 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941576+0000", 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023854 2024-09-16T04:08:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943570+0000", 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019934800000000002 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949041+0000", 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005471722 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958969+0000", 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099272460000000007 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959202+0000", 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233477 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:21 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.756457601000001, 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028407564999999999, 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 21 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938711+0000", 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4330000000000001e-06 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938719+0000", 2024-09-16T04:08:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3189999999999995e-06 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938743+0000", 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3645000000000001e-05 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938782+0000", 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9013000000000001e-05 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944592+0000", 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005810267 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944817+0000", 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000224904 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960092+0000", 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015274846 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960315+0000", 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223095 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967117+0000", 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068020429999999998 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s2 34/31 ECSubWrite(tid=170, reqid=client.4631.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.723618327000001, 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020104377, 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971549+0000", 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971551+0000", 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6169999999999999e-06 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971575+0000", 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3878000000000001e-05 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971623+0000", 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8494e-05 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971641+0000", 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7944e-05 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971835+0000", 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019388000000000001 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971861+0000", 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6508000000000001e-05 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991592+0000", 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019731027000000002 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991653+0000", 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1029000000000001e-05 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:58 3.as0 3:57bc9072:::smithi20431790-20:head [append 0~327680,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.722455002, 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023641881999999999, 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 58 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972715+0000", 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1310000000000002e-06 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973401+0000", 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068536200000000002 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973436+0000", 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4777000000000003e-05 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973457+0000", 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1047e-05 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973758+0000", 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000301716 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974093+0000", 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033437899999999999 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976226+0000", 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021329019999999999 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991758+0000", 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015532035 2024-09-16T04:08:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044259850000000003 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996354+0000", 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017054799999999999 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:59 3.as0 3:57bc9072:::smithi20431790-20:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.721659052, 2024-09-16T04:08:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023229295, 2024-09-16T04:08:47.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 59 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973510+0000", 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973519+0000", 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9449999999999999e-06 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973678+0000", 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158815 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973702+0000", 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.461e-05 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977799+0000", 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040967520000000004 2024-09-16T04:08:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978040+0000", 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024069299999999999 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979318+0000", 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001278164 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991761+0000", 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012442844999999999 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996561+0000", 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048005419999999997 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996738+0000", 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017617199999999999 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:60 3.as0 3:57bc9072:::smithi20431790-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.721433388000001, 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034426401000000002, 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 60 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973736+0000", 2024-09-16T04:08:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-06 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973746+0000", 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0056e-05 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973770+0000", 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3966999999999999e-05 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973785+0000", 2024-09-16T04:08:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5512999999999999e-05 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979953+0000", 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061678890000000002 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980244+0000", 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029044900000000002 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996914+0000", 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016670404999999999 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997079+0000", 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165126 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008160+0000", 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011081036000000001 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:64 3.as0 3:5581c6e4:::smithi20431790-22:head [append 0~360448,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.716712560000001, 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024425922999999999, 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 64 2024-09-16T04:08:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978458+0000", 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7429999999999998e-06 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979197+0000", 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073908700000000003 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979227+0000", 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0793999999999997e-05 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979247+0000", 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0078999999999999e-05 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980478+0000", 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012303170000000001 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981002+0000", 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052460899999999999 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990256+0000", 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092540160000000003 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002501+0000", 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012244649 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002743+0000", 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024201600000000001 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002881+0000", 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137613 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:65 3.as0 3:5581c6e4:::smithi20431790-22:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.715884823, 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027732105, 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 65 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979284+0000", 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.711e-06 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979382+0000", 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8177999999999994e-05 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979409+0000", 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6435e-05 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979459+0000", 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0192999999999999e-05 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993281+0000", 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013822302 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993476+0000", 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019474100000000001 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994583+0000", 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001106473 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003469+0000", 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088860840000000007 2024-09-16T04:08:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006865+0000", 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033959749999999999 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007015+0000", 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150013 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:66 3.as0 3:5581c6e4:::smithi20431790-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.715680088999999, 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.035359943999999997, 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 66 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979489+0000", 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5999999999999999e-06 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979496+0000", 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0820000000000001e-06 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979516+0000", 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9779000000000002e-05 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979530+0000", 2024-09-16T04:08:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4198e-05 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994979+0000", 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015449176 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995185+0000", 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000206391 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008423+0000", 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013237844 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008619+0000", 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195582 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.014847+0000", 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062282919999999999 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:67 3.ds0 3:bc48267e:::smithi20431790-23:head [append 0~376832,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.713392474999999, 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020232841000000001, 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 67 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981785+0000", 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982754+0000", 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096953899999999995 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982787+0000", 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3216999999999997e-05 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982807+0000", 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9304e-05 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983165+0000", 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035800399999999998 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983490+0000", 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032504399999999997 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985908+0000", 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024180780000000002 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994386+0000", 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084781360000000007 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001861+0000", 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074755220000000001 2024-09-16T04:08:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002008+0000", 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014632299999999999 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:69 3.ds0 3:bc48267e:::smithi20431790-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.712221107000001, 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028842145999999999, 2024-09-16T04:08:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 69 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982948+0000", 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-06 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982989+0000", 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1464999999999997e-05 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983013+0000", 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3703999999999999e-05 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983029+0000", 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5843999999999999e-05 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990775+0000", 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077465149999999998 2024-09-16T04:08:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991025+0000", 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024982599999999998 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003046+0000", 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012021118000000001 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003451+0000", 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040476500000000002 2024-09-16T04:08:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011788+0000", 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008337555 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:75 3.fs0 3:f2191a5d:::smithi20431790-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.703025657000001, 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019651762999999999, 2024-09-16T04:08:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 75 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992142+0000", 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992143+0000", 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992149+0000", 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1449999999999996e-06 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992169+0000", 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0169999999999998e-05 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992184+0000", 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4389999999999999e-05 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994919+0000", 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002735754 2024-09-16T04:08:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995184+0000", 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000264481 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006682+0000", 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011498441999999999 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006786+0000", 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010324500000000001 2024-09-16T04:08:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011793+0000", 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005007933 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:308 3.as0 3:57bc9072:::smithi20431790-20:head [copy-from ver 2] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.650641134000001, 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020181012000000002, 2024-09-16T04:08:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 308 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044530+0000", 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8260000000000003e-06 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044545+0000", 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4922999999999999e-05 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044581+0000", 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5763999999999998e-05 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044602+0000", 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1662e-05 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044981+0000", 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378907 2024-09-16T04:08:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.045271+0000", 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000289945 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.058303+0000", 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013031612999999999 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061763+0000", 2024-09-16T04:08:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034603099999999999 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064481+0000", 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002717849 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064707+0000", 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022621300000000001 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:470 3.fs0 3:f2191a5d:::smithi20431790-25:head [copy-from ver 0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8424330800000002, 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020390709999999999, 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 470 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852737+0000", 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2370000000000001e-06 2024-09-16T04:08:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852753+0000", 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5056e-05 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852786+0000", 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3105000000000002e-05 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852802+0000", 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-16T04:08:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852975+0000", 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017205200000000001 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852988+0000", 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.324e-05 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859023+0000", 2024-09-16T04:08:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060348279999999999 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859276+0000", 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025340600000000002 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873125+0000", 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013848973000000001 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:471 3.fs0 3:f2191a5d:::smithi20431790-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8423254440000001, 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021425564000000001, 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 471 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852843+0000", 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5000000000000001e-07 2024-09-16T04:08:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852848+0000", 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9400000000000001e-06 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852864+0000", 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6606e-05 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852874+0000", 2024-09-16T04:08:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9590000000000007e-06 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853159+0000", 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028422899999999999 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853179+0000", 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0692000000000001e-05 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859762+0000", 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065823050000000001 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for blocked object", 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859940+0000", 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017856600000000001 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873687+0000", 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013747120999999999 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873971+0000", 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028401799999999998 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874267+0000", 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029617800000000002 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:472 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8422199949999998, 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022526906999999999, 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 472 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852949+0000", 2024-09-16T04:08:47.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.753e-06 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852957+0000", 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7100000000000007e-06 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852982+0000", 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4745000000000001e-05 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852996+0000", 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3963e-05 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853399+0000", 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040381400000000001 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853420+0000", 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0525000000000001e-05 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860064+0000", 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066444 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860233+0000", 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000168486 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.862013+0000", 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001780626 2024-09-16T04:08:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874451+0000", 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012437521 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.875343+0000", 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089236299999999997 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.875474+0000", 2024-09-16T04:08:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131001 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:473 3.fs0 3:fb02b556:::smithi20431790-7:head [rollback f] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8421552840000004, 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023677446000000001, 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 473 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853013+0000", 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.23e-07 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853017+0000", 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5059999999999997e-06 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853029+0000", 2024-09-16T04:08:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1653e-05 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853037+0000", 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6469999999999998e-06 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853512+0000", 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000475413 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853522+0000", 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864892+0000", 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01137 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.865279+0000", 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000386857 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.868280+0000", 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030007079999999999 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874454+0000", 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006174489 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.876467+0000", 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020123160000000001 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.876689+0000", 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022274799999999999 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:474 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.8420911640000002, 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024572546000000001, 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:08:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 474 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853077+0000", 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2729999999999999e-06 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853084+0000", 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9999999999999999e-06 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853106+0000", 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1063000000000001e-05 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853121+0000", 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5862000000000002e-05 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853593+0000", 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047153100000000002 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853603+0000", 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0402e-05 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869443+0000", 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015839776999999999 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:08:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869707+0000", 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026354599999999997 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.872401+0000", 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026945939999999998 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874705+0000", 2024-09-16T04:08:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023035640000000001 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.877404+0000", 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026990410000000001 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.877649+0000", 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024489299999999999 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:08:47.815 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:08:47.815 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:08:47.816 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:08:47.817 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:47.812+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:47.912 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:215: done (1 left) 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:217: done (0 left) 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:218: read oid 23 snap 15 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:218: expect deleted 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:219: read oid 47 snap -1 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:219: expect deleted 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:220: copy_from oid 32 from oid 48 current snap is 16 2024-09-16T04:08:47.914 INFO:tasks.rados.rados.0.smithi204.stdout:221: setattr oid 14 current snap is 16 2024-09-16T04:08:47.916 INFO:tasks.rados.rados.0.smithi204.stdout:218: done (3 left) 2024-09-16T04:08:47.916 INFO:tasks.rados.rados.0.smithi204.stdout:222: snap_remove snap 15 2024-09-16T04:08:47.917 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:47.910+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:47.957 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:47.957 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:47.958 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:47.958 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:47.972 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:08:48.018 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:48.016+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:48.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:48.118 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:48.116+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:48.137 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:48.138 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:48.138 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:48.138 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:48.138 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:48.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:08:48.219 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:48.217+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:48.253 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:48.254 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:48.273 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:48.273 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:48.273 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:48.273 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:48.273 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.273 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.332481783999999, 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088452600000000006, 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.274 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7599999999999997e-07 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937675+0000", 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000112378 2024-09-16T04:08:48.275 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1192e-05 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937716+0000", 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9786e-05 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.276 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937875+0000", 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015905699999999999 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937897+0000", 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2442999999999998e-05 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946338+0000", 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084413119999999994 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.277 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946407+0000", 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8516000000000006e-05 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.330890226000001, 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073144209999999998, 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.278 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.279 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939155+0000", 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.823e-06 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939194+0000", 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9060999999999998e-05 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939224+0000", 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0009e-05 2024-09-16T04:08:48.280 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939288+0000", 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4290999999999998e-05 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939471+0000", 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018293899999999999 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.281 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939493+0000", 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1849999999999999e-05 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946414+0000", 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069205860000000003 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946468+0000", 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3862e-05 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.282 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=0, reqid=client.4631.0:34, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.316110646999999, 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010827755999999999, 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.283 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953934+0000", 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3099999999999996e-07 2024-09-16T04:08:48.284 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955299+0000", 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001365401 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955338+0000", 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8804000000000003e-05 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955361+0000", 2024-09-16T04:08:48.285 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3472000000000002e-05 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000184064 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955568+0000", 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2425e-05 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.286 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964640+0000", 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090716189999999995 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964761+0000", 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012104000000000001 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=2, reqid=client.4631.0:17, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.313674154000001, 2024-09-16T04:08:48.287 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093557269999999994, 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.288 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956371+0000", 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9069999999999999e-06 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956399+0000", 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7784999999999999e-05 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.289 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956441+0000", 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1727999999999998e-05 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956464+0000", 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2991999999999999e-05 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956620+0000", 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015645500000000001 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.290 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956649+0000", 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8438000000000001e-05 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965629+0000", 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089807140000000008 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965725+0000", 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5707999999999999e-05 2024-09-16T04:08:48.291 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 34/31 ECSubWrite(tid=2, reqid=client.4631.0:5, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.313455002000001, 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092008920000000004, 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.292 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.293 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956590+0000", 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5060000000000001e-06 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956611+0000", 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1123000000000001e-05 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956633+0000", 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1464999999999999e-05 2024-09-16T04:08:48.294 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956651+0000", 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8113000000000001e-05 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956835+0000", 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018435000000000001 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.295 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956855+0000", 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9629000000000001e-05 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965720+0000", 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088648259999999993 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965789+0000", 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9880000000000002e-05 2024-09-16T04:08:48.296 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=1, reqid=client.4631.0:35, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.310664451000001, 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006492589, 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.297 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959380+0000", 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.42e-06 2024-09-16T04:08:48.298 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959416+0000", 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5373000000000002e-05 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959452+0000", 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6328999999999997e-05 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.299 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959471+0000", 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8991000000000002e-05 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959623+0000", 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015206900000000001 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959635+0000", 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1712000000000001e-05 2024-09-16T04:08:48.300 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965813+0000", 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061778650000000003 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965872+0000", 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8829999999999997e-05 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.301 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 34/31 ECSubWrite(tid=8, reqid=client.4631.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.308618452000001, 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048114000000000004, 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.302 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961426+0000", 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5900000000000005e-07 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.303 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961448+0000", 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2376000000000001e-05 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961480+0000", 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1862000000000001e-05 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961504+0000", 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3921e-05 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.304 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961641+0000", 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013634000000000001 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961659+0000", 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8451e-05 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966086+0000", 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044267330000000004 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.305 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966236+0000", 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000150758 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds5 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.283865364, 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0064133979999999998, 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.306 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.307 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986180+0000", 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.61e-06 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986500+0000", 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00032045199999999999 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986536+0000", 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5522999999999999e-05 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.308 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986565+0000", 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9445999999999999e-05 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986758+0000", 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019237 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986779+0000", 2024-09-16T04:08:48.309 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1359e-05 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992509+0000", 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0057302610000000004 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992592+0000", 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2377000000000001e-05 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.310 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 17.417261927999999, 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094335619999999995, 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.311 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3300000000000001e-07 2024-09-16T04:08:48.312 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852840+0000", 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8068e-05 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852875+0000", 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4016000000000001e-05 2024-09-16T04:08:48.313 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852916+0000", 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1301000000000003e-05 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853436+0000", 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052021800000000003 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853462+0000", 2024-09-16T04:08:48.314 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5602e-05 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862103+0000", 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086416559999999993 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862215+0000", 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011186799999999999 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.315 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 17.416744443999999, 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088015860000000001, 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.316 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853300+0000", 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853354+0000", 2024-09-16T04:08:48.317 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3897999999999998e-05 2024-09-16T04:08:48.318 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.318 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.318 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.318 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853383+0000", 2024-09-16T04:08:48.318 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9689e-05 2024-09-16T04:08:48.318 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853406+0000", 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2289e-05 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853644+0000", 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023859799999999999 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853670+0000", 2024-09-16T04:08:48.319 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5609000000000002e-05 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.861999+0000", 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083290640000000006 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862101+0000", 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000101846 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.320 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 54/31 ECSubWrite(tid=72, reqid=osd.5.0:72, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070520+0000", 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.199523487, 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006188051, 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070520+0000", 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.321 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070520+0000", 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070521+0000", 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.0599999999999999e-07 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.322 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070586+0000", 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4691999999999997e-05 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070619+0000", 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3732000000000002e-05 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070645+0000", 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5579e-05 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.323 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070878+0000", 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000233556 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070904+0000", 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5812999999999998e-05 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.076594+0000", 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0056900600000000003 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.324 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.076708+0000", 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000113713 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 54/31 ECSubWrite(tid=97, reqid=osd.13.0:97, at_version=54'27, trim_to=0'0, roll_forward_to=52'25))", 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.195967069, 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006242633, 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.325 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.326 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074077+0000", 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8299999999999995e-07 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074158+0000", 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0173999999999995e-05 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074189+0000", 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1086e-05 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.327 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074228+0000", 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9184999999999998e-05 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074411+0000", 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018316400000000001 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074437+0000", 2024-09-16T04:08:48.328 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6023000000000001e-05 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080222+0000", 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005785241 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080319+0000", 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6877000000000001e-05 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.329 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 54/31 ECSubWrite(tid=36, reqid=osd.8.0:35, at_version=0'0, trim_to=0'0, roll_forward_to=54'23))", 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.084619+0000", 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.185424412, 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0052821229999999997, 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084619+0000", 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.330 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084619+0000", 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084621+0000", 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9829999999999999e-06 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084650+0000", 2024-09-16T04:08:48.331 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8745999999999999e-05 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084680+0000", 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0049e-05 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084705+0000", 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5585999999999999e-05 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.332 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084917+0000", 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021142000000000001 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084942+0000", 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4632000000000001e-05 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089802+0000", 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048603639999999998 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.333 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089901+0000", 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9343000000000001e-05 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=100, reqid=osd.13.0:98, at_version=0'0, trim_to=0'0, roll_forward_to=54'9))", 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.087662+0000", 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.182381321999999, 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.004865711, 2024-09-16T04:08:48.334 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087662+0000", 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087662+0000", 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.335 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087664+0000", 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8199999999999999e-06 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087692+0000", 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8056e-05 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087724+0000", 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1686000000000001e-05 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.336 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087747+0000", 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3439e-05 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087955+0000", 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020818400000000001 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087995+0000", 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.0089000000000002e-05 2024-09-16T04:08:48.337 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.092444+0000", 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044484950000000002 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.092528+0000", 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3942000000000004e-05 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 54/31 ECSubWrite(tid=75, reqid=osd.5.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=54'21))", 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.180612411, 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062013679999999996, 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.339 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089433+0000", 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0470000000000001e-06 2024-09-16T04:08:48.340 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089464+0000", 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0451999999999999e-05 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089503+0000", 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9721999999999997e-05 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.341 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089528+0000", 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4375999999999998e-05 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089700+0000", 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017223499999999999 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089724+0000", 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4485999999999999e-05 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.342 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.095544+0000", 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058195529999999999 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.095632+0000", 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8497000000000003e-05 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.343 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=88, reqid=client.4631.0:469, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:41.870395+0000", 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 6.3996488400000002, 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0051398069999999997, 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870395+0000", 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.344 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870395+0000", 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870397+0000", 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9369999999999998e-06 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.345 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870418+0000", 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1189999999999999e-05 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870457+0000", 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8924999999999997e-05 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870480+0000", 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2878999999999999e-05 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.346 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870621+0000", 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014113299999999999 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870639+0000", 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8206000000000002e-05 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.875443+0000", 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048040640000000003 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.347 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.875534+0000", 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.1472999999999996e-05 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 60/31 ECSubWrite(tid=39, reqid=osd.8.0:39, at_version=60'27, trim_to=0'0, roll_forward_to=57'25))", 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 5.3878865239999998, 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069862259999999999, 2024-09-16T04:08:48.348 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.349 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882158+0000", 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0130000000000001e-06 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882227+0000", 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8670999999999994e-05 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882263+0000", 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6729e-05 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.350 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882287+0000", 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3963000000000001e-05 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882459+0000", 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017120899999999999 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882486+0000", 2024-09-16T04:08:48.351 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7611999999999999e-05 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889027+0000", 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065408530000000001 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889143+0000", 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011617599999999999 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.352 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 63/31 ECSubWrite(tid=110, reqid=client.4631.0:509, at_version=63'54, trim_to=0'0, roll_forward_to=63'53))", 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 2.093215115, 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073621579999999997, 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.353 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176830+0000", 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0760000000000001e-06 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179214+0000", 2024-09-16T04:08:48.354 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0023831529999999998 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179253+0000", 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9088999999999998e-05 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179284+0000", 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.355 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179490+0000", 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020643500000000001 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179520+0000", 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9822999999999999e-05 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184081+0000", 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0045612500000000002 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.356 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184191+0000", 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010942699999999999 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 64/31 ECSubWrite(tid=46, reqid=osd.15.0:46, at_version=64'31, trim_to=0'0, roll_forward_to=63'29))", 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.913145+0000", 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.3568981369999999, 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0055190760000000004, 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.357 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913145+0000", 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913145+0000", 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.358 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913146+0000", 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1200000000000001e-06 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913199+0000", 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2404999999999997e-05 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913242+0000", 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2849000000000003e-05 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.359 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913265+0000", 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3710000000000002e-05 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913471+0000", 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000205637 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913498+0000", 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7250000000000002e-05 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.360 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918562+0000", 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050638239999999998 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918664+0000", 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010228100000000001 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.361 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 64/31 ECSubWrite(tid=114, reqid=osd.5.0:113, at_version=0'0, trim_to=0'0, roll_forward_to=64'58))", 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 1.340397088, 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098458810000000008, 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.362 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929652+0000", 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929681+0000", 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9323e-05 2024-09-16T04:08:48.363 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929713+0000", 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1639e-05 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929735+0000", 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2246e-05 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929957+0000", 2024-09-16T04:08:48.364 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022144100000000001 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929982+0000", 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5636e-05 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.939392+0000", 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094095789999999995 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:48.365 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.939492+0000", 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000100444 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:48.366 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:48.367 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:48.368 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:48.369 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:48.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:08:48.369 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:48.362+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:48.370 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:48.370 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:48.370 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:48.370 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:48.371 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:48.371 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:48.376 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:48.376 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:48.397 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:48.397 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:48.417 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:48.440 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:48.441 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:48.462 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:48.469 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:48.465+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:48.485 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:48.485 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:48.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:48.506 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:48.529 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:48.530 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:48.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:48.529+0000 7f36e3fff640 0 -- 172.21.15.32:0/2078013241 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7f36e4222080 msgr2=0x7f36e4224470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T04:08:48.537 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:48.537 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:48.551 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:08:48.569 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:48.565+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:48.670 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:48.670 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:48.670 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:48.667+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:48.683 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:08:48.757 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:48.758 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:48.771 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:48.767+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:48.791 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:48.791 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:48.806 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:48.807 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:48.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:08:48.874 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:48.869+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:48.919 INFO:tasks.rados.rados.0.smithi204.stdout:222: done (3 left) 2024-09-16T04:08:48.919 INFO:tasks.rados.rados.0.smithi204.stdout:223: read oid 15 snap -1 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:223: expect (ObjNum 86 snap 11 seq_num 86) 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:224: rollback oid 12 current snap is 16 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:224: done (4 left) 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:225: copy_from oid 1 from oid 27 current snap is 16 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:226: copy_from oid 3 from oid 38 current snap is 16 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 14 v 148 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-16T04:08:48.920 INFO:tasks.rados.rados.0.smithi204.stdout:220: finishing copy_from racing read to smithi20431790-32 2024-09-16T04:08:48.921 INFO:tasks.rados.rados.0.smithi204.stdout:219: done (5 left) 2024-09-16T04:08:48.921 INFO:tasks.rados.rados.0.smithi204.stdout:221: done (4 left) 2024-09-16T04:08:48.921 INFO:tasks.rados.rados.0.smithi204.stdout:227: delete oid 46 current snap is 16 2024-09-16T04:08:48.921 INFO:tasks.rados.rados.0.smithi204.stdout:220: finishing copy_from to smithi20431790-32 2024-09-16T04:08:48.921 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 32 v 9 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-16T04:08:48.936 INFO:tasks.rados.rados.0.smithi204.stdout:220: done (4 left) 2024-09-16T04:08:48.936 INFO:tasks.rados.rados.0.smithi204.stdout:227: done (3 left) 2024-09-16T04:08:48.936 INFO:tasks.rados.rados.0.smithi204.stdout:228: read oid 33 snap -1 2024-09-16T04:08:48.936 INFO:tasks.rados.rados.0.smithi204.stdout:228: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:48.936 INFO:tasks.rados.rados.0.smithi204.stdout:229: read oid 7 snap -1 2024-09-16T04:08:48.936 INFO:tasks.rados.rados.0.smithi204.stdout:229: expect (ObjNum 81 snap 8 seq_num 81) 2024-09-16T04:08:48.937 INFO:tasks.rados.rados.0.smithi204.stdout:230: delete oid 30 current snap is 16 2024-09-16T04:08:48.946 INFO:tasks.rados.rados.0.smithi204.stdout:225: finishing copy_from racing read to smithi20431790-1 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:230: done (5 left) 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:231: read oid 39 snap -1 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:231: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:232: read oid 44 snap -1 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:232: expect (ObjNum 91 snap 13 seq_num 91) 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 19 current snap is 16 2024-09-16T04:08:48.949 INFO:tasks.rados.rados.0.smithi204.stdout:233: seq_num 105 ranges {2097152=606208,2703360=688128,3391488=475136} 2024-09-16T04:08:48.958 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:48.958 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:48.974 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:48.967+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:48.974 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:08:48.985 INFO:tasks.rados.rados.0.smithi204.stdout:233: writing smithi20431790-19 from 2097152 to 2703360 tid 1 2024-09-16T04:08:48.993 INFO:tasks.rados.rados.0.smithi204.stdout:233: writing smithi20431790-19 from 2703360 to 3391488 tid 2 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:233: writing smithi20431790-19 from 3391488 to 3866624 tid 3 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:234: read oid 34 snap -1 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:234: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:235: read oid 21 snap -1 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:235: expect (ObjNum 64 snap 4 seq_num 64) 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 10 current snap is 16 2024-09-16T04:08:48.998 INFO:tasks.rados.rados.0.smithi204.stdout:228: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:49.024 INFO:tasks.rados.rados.0.smithi204.stdout:226: finishing copy_from racing read to smithi20431790-3 2024-09-16T04:08:49.024 INFO:tasks.rados.rados.0.smithi204.stdout:225: finishing copy_from to smithi20431790-1 2024-09-16T04:08:49.024 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 1 v 10 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-16T04:08:49.024 INFO:tasks.rados.rados.0.smithi204.stdout:223: expect (ObjNum 86 snap 11 seq_num 86) 2024-09-16T04:08:49.074 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:49.070+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:49.097 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:49.097 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:49.111 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:08:49.137 INFO:tasks.rados.rados.0.smithi204.stdout:231: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:08:49.153 INFO:tasks.rados.rados.0.smithi204.stdout:229: expect (ObjNum 81 snap 8 seq_num 81) 2024-09-16T04:08:49.178 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:49.175+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:49.192 INFO:tasks.rados.rados.0.smithi204.stdout:226: finishing copy_from to smithi20431790-3 2024-09-16T04:08:49.192 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 3 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-16T04:08:49.193 INFO:tasks.rados.rados.0.smithi204.stdout:232: expect (ObjNum 91 snap 13 seq_num 91) 2024-09-16T04:08:49.279 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:49.275+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:49.282 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:49.282 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:49.296 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:08:49.320 INFO:tasks.rados.rados.0.smithi204.stdout:233: finishing write tid 1 to smithi20431790-19 2024-09-16T04:08:49.320 INFO:tasks.rados.rados.0.smithi204.stdout:233: finishing write tid 2 to smithi20431790-19 2024-09-16T04:08:49.320 INFO:tasks.rados.rados.0.smithi204.stdout:236: seq_num 106 ranges {163840=622592,786432=442368,1228800=524288,1753088=196608} 2024-09-16T04:08:49.324 INFO:tasks.rados.rados.0.smithi204.stdout:236: writing smithi20431790-10 from 163840 to 786432 tid 1 2024-09-16T04:08:49.327 INFO:tasks.rados.rados.0.smithi204.stdout:236: writing smithi20431790-10 from 786432 to 1228800 tid 2 2024-09-16T04:08:49.330 INFO:tasks.rados.rados.0.smithi204.stdout:236: writing smithi20431790-10 from 1228800 to 1753088 tid 3 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:236: writing smithi20431790-10 from 1753088 to 1949696 tid 4 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:223: done (10 left) 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:225: done (9 left) 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:226: done (8 left) 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:228: done (7 left) 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:229: done (6 left) 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:231: done (5 left) 2024-09-16T04:08:49.331 INFO:tasks.rados.rados.0.smithi204.stdout:232: done (4 left) 2024-09-16T04:08:49.332 INFO:tasks.rados.rados.0.smithi204.stdout:237: read oid 35 snap -1 2024-09-16T04:08:49.332 INFO:tasks.rados.rados.0.smithi204.stdout:237: expect (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:49.332 INFO:tasks.rados.rados.0.smithi204.stdout:238: delete oid 26 current snap is 16 2024-09-16T04:08:49.332 INFO:tasks.rados.rados.0.smithi204.stdout:233: finishing write tid 3 to smithi20431790-19 2024-09-16T04:08:49.332 INFO:tasks.rados.rados.0.smithi204.stdout:233: finishing write tid 4 to smithi20431790-19 2024-09-16T04:08:49.332 INFO:tasks.rados.rados.0.smithi204.stdout:234: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-16T04:08:49.347 INFO:tasks.rados.rados.0.smithi204.stdout:233: finishing write tid 5 to smithi20431790-19 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:233: oid 19 updating version 0 to 155 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:233: oid 19 version 155 is already newer than 153 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:233: oid 19 version 155 is already newer than 154 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:233: oid 19 version 155 is already newer than 152 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 19 v 155 (ObjNum 105 snap 16 seq_num 105) dirty exists 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:233: left oid 19 (ObjNum 105 snap 16 seq_num 105) 2024-09-16T04:08:49.348 INFO:tasks.rados.rados.0.smithi204.stdout:235: expect (ObjNum 64 snap 4 seq_num 64) 2024-09-16T04:08:49.382 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:49.375+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:49.389 INFO:tasks.rados.rados.0.smithi204.stdout:236: finishing write tid 1 to smithi20431790-10 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:236: finishing write tid 2 to smithi20431790-10 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:236: finishing write tid 3 to smithi20431790-10 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:233: done (5 left) 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:234: done (4 left) 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:235: done (3 left) 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:238: done (2 left) 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:239: copy_from oid 50 from oid 49 current snap is 16 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:236: finishing write tid 4 to smithi20431790-10 2024-09-16T04:08:49.390 INFO:tasks.rados.rados.0.smithi204.stdout:236: finishing write tid 5 to smithi20431790-10 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: finishing write tid 6 to smithi20431790-10 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: oid 10 updating version 0 to 91 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: oid 10 version 91 is already newer than 90 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: oid 10 updating version 91 to 93 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: oid 10 updating version 93 to 94 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: oid 10 version 94 is already newer than 92 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 10 v 94 (ObjNum 106 snap 16 seq_num 106) dirty exists 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:236: left oid 10 (ObjNum 106 snap 16 seq_num 106) 2024-09-16T04:08:49.391 INFO:tasks.rados.rados.0.smithi204.stdout:237: expect (ObjNum 66 snap 4 seq_num 66) 2024-09-16T04:08:49.419 INFO:tasks.rados.rados.0.smithi204.stdout:239: finishing copy_from racing read to smithi20431790-50 2024-09-16T04:08:49.419 INFO:tasks.rados.rados.0.smithi204.stdout:236: done (2 left) 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:237: done (1 left) 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:240: copy_from oid 18 from oid 10 current snap is 16 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:241: read oid 3 snap -1 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:241: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:242: setattr oid 44 current snap is 16 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:239: finishing copy_from to smithi20431790-50 2024-09-16T04:08:49.420 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 50 v 60 (ObjNum 89 snap 11 seq_num 89) dirty exists 2024-09-16T04:08:49.422 INFO:tasks.rados.rados.0.smithi204.stdout:239: done (3 left) 2024-09-16T04:08:49.422 INFO:tasks.rados.rados.0.smithi204.stdout:243: rollback oid 21 current snap is 16 2024-09-16T04:08:49.422 INFO:tasks.rados.rados.0.smithi204.stdout:243: done (3 left) 2024-09-16T04:08:49.422 INFO:tasks.rados.rados.0.smithi204.stdout:244: read oid 20 snap -1 2024-09-16T04:08:49.422 INFO:tasks.rados.rados.0.smithi204.stdout:244: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:49.422 INFO:tasks.rados.rados.0.smithi204.stdout:245: snap_create 2024-09-16T04:08:49.431 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:49.432 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:49.432 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 59 (ObjNum 91 snap 13 seq_num 91) dirty exists 2024-09-16T04:08:49.437 INFO:tasks.rados.rados.0.smithi204.stdout:240: finishing copy_from racing read to smithi20431790-18 2024-09-16T04:08:49.439 INFO:tasks.rados.rados.0.smithi204.stdout:241: expect (ObjNum 37 snap 0 seq_num 37) 2024-09-16T04:08:49.449 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:08:49.455 INFO:tasks.rados.rados.0.smithi204.stdout:240: finishing copy_from to smithi20431790-18 2024-09-16T04:08:49.455 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 18 v 94 (ObjNum 106 snap 16 seq_num 106) dirty exists 2024-09-16T04:08:49.455 INFO:tasks.rados.rados.0.smithi204.stdout:244: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:49.493 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:49.490+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:49.569 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:49.569 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:49.586 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:49.580+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:49.587 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:08:49.686 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:49.685+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:49.755 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:49.755 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:49.769 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:08:49.789 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:49.788+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:240: done (4 left) 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:241: done (3 left) 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:242: done (2 left) 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:244: done (1 left) 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:245: done (0 left) 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 45 current snap is 17 2024-09-16T04:08:49.849 INFO:tasks.rados.rados.0.smithi204.stdout:246: seq_num 108 ranges {3047424=655360,3702784=606208,4308992=475136,4784128=81920} 2024-09-16T04:08:49.877 INFO:tasks.rados.rados.0.smithi204.stdout:246: writing smithi20431790-45 from 3047424 to 3702784 tid 1 2024-09-16T04:08:49.882 INFO:tasks.rados.rados.0.smithi204.stdout:246: writing smithi20431790-45 from 3702784 to 4308992 tid 2 2024-09-16T04:08:49.887 INFO:tasks.rados.rados.0.smithi204.stdout:246: writing smithi20431790-45 from 4308992 to 4784128 tid 3 2024-09-16T04:08:49.888 INFO:tasks.rados.rados.0.smithi204.stdout:246: writing smithi20431790-45 from 4784128 to 4866048 tid 4 2024-09-16T04:08:49.888 INFO:tasks.rados.rados.0.smithi204.stdout:247: rmattr oid 10 current snap is 17 2024-09-16T04:08:49.888 INFO:tasks.rados.rados.0.smithi204.stdout:247: done (1 left) 2024-09-16T04:08:49.888 INFO:tasks.rados.rados.0.smithi204.stdout:248: snap_remove snap 16 2024-09-16T04:08:49.889 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:49.883+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:49.907 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:49.907 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:49.922 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:08:49.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-16T04:08:50.014 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:50.011+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:50.093 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:50.087+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:50.094 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.094 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.108 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:08:50.195 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:50.192+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:50.266 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.267 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.280 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:08:50.296 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:50.290+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:50.397 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.397 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.397 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:50.392+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:50.411 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:08:50.498 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:50.496+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:50.522 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.523 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.535 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:08:50.599 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:08:50.594+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:08:50.644 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.645 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.657 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:08:50.700 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:50.696+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:50.777 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.778 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.791 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:08:50.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:50.794+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:50.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:50.846 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-16T04:08:50.849 INFO:tasks.rados.rados.0.smithi204.stdout:248: done (1 left) 2024-09-16T04:08:50.849 INFO:tasks.rados.rados.0.smithi204.stdout:249: delete oid 37 current snap is 17 2024-09-16T04:08:50.849 INFO:tasks.rados.rados.0.smithi204.stdout:246: finishing write tid 1 to smithi20431790-45 2024-09-16T04:08:50.849 INFO:tasks.rados.rados.0.smithi204.stdout:246: finishing write tid 2 to smithi20431790-45 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: finishing write tid 3 to smithi20431790-45 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: finishing write tid 4 to smithi20431790-45 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: finishing write tid 5 to smithi20431790-45 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: finishing write tid 6 to smithi20431790-45 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: oid 45 updating version 0 to 159 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: oid 45 updating version 159 to 161 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: oid 45 version 161 is already newer than 160 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: oid 45 version 161 is already newer than 158 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: oid 45 version 161 is already newer than 157 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 45 v 161 (ObjNum 108 snap 17 seq_num 108) dirty exists 2024-09-16T04:08:50.850 INFO:tasks.rados.rados.0.smithi204.stdout:246: left oid 45 (ObjNum 108 snap 17 seq_num 108) 2024-09-16T04:08:50.858 INFO:tasks.rados.rados.0.smithi204.stdout:246: done (1 left) 2024-09-16T04:08:50.858 INFO:tasks.rados.rados.0.smithi204.stdout:249: done (0 left) 2024-09-16T04:08:50.858 INFO:tasks.rados.rados.0.smithi204.stdout:250: copy_from oid 5 from oid 17 current snap is 17 2024-09-16T04:08:50.858 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 6 current snap is 17 2024-09-16T04:08:50.858 INFO:tasks.rados.rados.0.smithi204.stdout:251: seq_num 110 ranges {0=688128,688128=507904,1196032=655360} 2024-09-16T04:08:50.863 INFO:tasks.rados.rados.0.smithi204.stdout:251: writing smithi20431790-6 from 0 to 688128 tid 1 2024-09-16T04:08:50.868 INFO:tasks.rados.rados.0.smithi204.stdout:251: writing smithi20431790-6 from 688128 to 1196032 tid 2 2024-09-16T04:08:50.873 INFO:tasks.rados.rados.0.smithi204.stdout:251: writing smithi20431790-6 from 1196032 to 1851392 tid 3 2024-09-16T04:08:50.874 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 28 current snap is 17 2024-09-16T04:08:50.874 INFO:tasks.rados.rados.0.smithi204.stdout:252: seq_num 111 ranges {0=704512,704512=655360,1359872=507904} 2024-09-16T04:08:50.880 INFO:tasks.rados.rados.0.smithi204.stdout:252: writing smithi20431790-28 from 0 to 704512 tid 1 2024-09-16T04:08:50.886 INFO:tasks.rados.rados.0.smithi204.stdout:252: writing smithi20431790-28 from 704512 to 1359872 tid 2 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:252: writing smithi20431790-28 from 1359872 to 1867776 tid 3 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:253: delete oid 19 current snap is 17 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:250: finishing copy_from to smithi20431790-5 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:250: got expected ENOENT (src dne) 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:250: finishing copy_from racing read to smithi20431790-5 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: finishing write tid 1 to smithi20431790-6 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: finishing write tid 2 to smithi20431790-6 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: finishing write tid 3 to smithi20431790-6 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: finishing write tid 4 to smithi20431790-6 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: finishing write tid 5 to smithi20431790-6 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: oid 6 updating version 0 to 98 2024-09-16T04:08:50.891 INFO:tasks.rados.rados.0.smithi204.stdout:251: oid 6 version 98 is already newer than 96 2024-09-16T04:08:50.892 INFO:tasks.rados.rados.0.smithi204.stdout:251: oid 6 version 98 is already newer than 97 2024-09-16T04:08:50.892 INFO:tasks.rados.rados.0.smithi204.stdout:251: oid 6 version 98 is already newer than 95 2024-09-16T04:08:50.892 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 6 v 98 (ObjNum 110 snap 17 seq_num 110) dirty exists 2024-09-16T04:08:50.892 INFO:tasks.rados.rados.0.smithi204.stdout:251: left oid 6 (ObjNum 110 snap 17 seq_num 110) 2024-09-16T04:08:50.892 INFO:tasks.rados.rados.0.smithi204.stdout:252: finishing write tid 1 to smithi20431790-28 2024-09-16T04:08:50.894 INFO:tasks.rados.rados.0.smithi204.stdout:250: done (3 left) 2024-09-16T04:08:50.894 INFO:tasks.rados.rados.0.smithi204.stdout:251: done (2 left) 2024-09-16T04:08:50.894 INFO:tasks.rados.rados.0.smithi204.stdout:253: done (1 left) 2024-09-16T04:08:50.894 INFO:tasks.rados.rados.0.smithi204.stdout:254: snap_create 2024-09-16T04:08:50.895 INFO:tasks.rados.rados.0.smithi204.stdout:252: finishing write tid 2 to smithi20431790-28 2024-09-16T04:08:50.896 INFO:tasks.rados.rados.0.smithi204.stdout:252: finishing write tid 3 to smithi20431790-28 2024-09-16T04:08:50.897 INFO:tasks.rados.rados.0.smithi204.stdout:252: finishing write tid 4 to smithi20431790-28 2024-09-16T04:08:50.900 INFO:tasks.rados.rados.0.smithi204.stdout:252: finishing write tid 5 to smithi20431790-28 2024-09-16T04:08:50.900 INFO:tasks.rados.rados.0.smithi204.stdout:252: oid 28 updating version 0 to 80 2024-09-16T04:08:50.900 INFO:tasks.rados.rados.0.smithi204.stdout:252: oid 28 updating version 80 to 83 2024-09-16T04:08:50.901 INFO:tasks.rados.rados.0.smithi204.stdout:252: oid 28 version 83 is already newer than 82 2024-09-16T04:08:50.901 INFO:tasks.rados.rados.0.smithi204.stdout:252: oid 28 version 83 is already newer than 81 2024-09-16T04:08:50.901 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 28 v 83 (ObjNum 111 snap 17 seq_num 111) dirty exists 2024-09-16T04:08:50.901 INFO:tasks.rados.rados.0.smithi204.stdout:252: left oid 28 (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:08:50.922 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:50.921+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:50.924 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:08:50.924 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:08:50.924 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-16T04:08:50.924 INFO:tasks.thrashosds.thrasher:Setting osd 11 primary_affinity to 0.734102 2024-09-16T04:08:50.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 0.7341023795882257 2024-09-16T04:08:50.927 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:50.928 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:50.941 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:08:50.992 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:50.992 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:51.002 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:50.997+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:51.013 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:51.034 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:51.034 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:51.048 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:51.049 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:51.054 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:51.061 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:08:51.072 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:51.072 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:51.093 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:51.094 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:51.103 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:51.098+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:51.114 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:51.115 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:51.136 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:51.136 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:51.154 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:51.154 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:51.175 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:51.175 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:51.182 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:51.182 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:51.196 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:51.196 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:51.197 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:08:51.203 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:51.200+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:51.217 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:51.217 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:51.238 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:51.239 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:51.262 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:51.262 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:51.285 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:51.285 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:51.304 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:51.300+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:51.307 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:51.319 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:51.319 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:51.319 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:51.319 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:51.319 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:51.333 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:08:51.405 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:51.401+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:16 3.3s0 3:c529a602:::smithi20431790-6:head [append 0~98304,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.515824918, 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019299383, 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.454 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 16 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.455 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935202+0000", 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1500000000000002e-06 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935324+0000", 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000121543 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.456 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935343+0000", 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9576e-05 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935354+0000", 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0305e-05 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935432+0000", 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.457 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935534+0000", 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102352 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936270+0000", 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00073583600000000002 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940246+0000", 2024-09-16T04:08:51.458 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039756180000000002 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954404+0000", 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014158278 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954499+0000", 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5575999999999994e-05 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.459 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:17 3.3s0 3:c529a602:::smithi20431790-6:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.515641741000003, 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019292492000000001, 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 17 2024-09-16T04:08:51.460 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.461 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935384+0000", 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4099999999999997e-07 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935389+0000", 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2329999999999997e-06 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8409999999999995e-06 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.462 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935409+0000", 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8600000000000005e-06 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936658+0000", 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012486140000000001 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936736+0000", 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8772999999999999e-05 2024-09-16T04:08:51.463 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937204+0000", 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046781200000000001 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941222+0000", 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0040175799999999998 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954596+0000", 2024-09-16T04:08:51.464 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013374425000000001 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954676+0000", 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9512999999999996e-05 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:18 3.3s0 3:c529a602:::smithi20431790-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.515604394, 2024-09-16T04:08:51.465 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.028831239000000002, 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 18 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.466 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4700000000000001e-07 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935425+0000", 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3689999999999998e-06 2024-09-16T04:08:51.467 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935433+0000", 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4379999999999995e-06 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935442+0000", 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2660000000000007e-06 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.468 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937434+0000", 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001991488 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937526+0000", 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2130000000000001e-05 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955047+0000", 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01752107 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.469 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955134+0000", 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7058000000000006e-05 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.964252+0000", 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091177729999999992 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.470 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:52 3.3s0 3:cd6753c4:::smithi20431790-18:head [append 0~294912,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965376+0000", 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.485648763, 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0078091469999999998, 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 52 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.471 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965376+0000", 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965376+0000", 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965377+0000", 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.850000000000001e-07 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.472 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965608+0000", 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000230745 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965622+0000", 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4066000000000001e-05 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965630+0000", 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5320000000000001e-06 2024-09-16T04:08:51.473 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965683+0000", 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3050000000000002e-05 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965802+0000", 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011954499999999999 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966444+0000", 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000642214 2024-09-16T04:08:51.474 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970010+0000", 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035652359999999998 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973093+0000", 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0030833259999999999 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973185+0000", 2024-09-16T04:08:51.475 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2448000000000007e-05 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:53 3.3s0 3:cd6753c4:::smithi20431790-18:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.485379254999998, 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0082006900000000001, 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.476 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 53 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.477 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965646+0000", 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2500000000000005e-07 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965650+0000", 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.794e-06 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965657+0000", 2024-09-16T04:08:51.478 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.17e-06 2024-09-16T04:08:51.479 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.479 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.479 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.479 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965663+0000", 2024-09-16T04:08:51.479 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8119999999999996e-06 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966972+0000", 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013091089999999999 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967054+0000", 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1687999999999994e-05 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.480 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967444+0000", 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038982600000000002 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.972552+0000", 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051083880000000002 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973765+0000", 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012128569999999999 2024-09-16T04:08:51.481 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973846+0000", 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1321000000000003e-05 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:54 3.3s0 3:cd6753c4:::smithi20431790-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.485353347, 2024-09-16T04:08:51.482 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012514735000000001, 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 54 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.483 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.484 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8500000000000002e-07 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965675+0000", 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.717e-06 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.485 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965681+0000", 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3740000000000003e-06 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965688+0000", 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1319999999999996e-06 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967631+0000", 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001942608 2024-09-16T04:08:51.486 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967683+0000", 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2407000000000002e-05 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0065591089999999996 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.487 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974296+0000", 2024-09-16T04:08:51.488 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.304e-05 2024-09-16T04:08:51.488 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.488 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.488 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.488 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978186+0000", 2024-09-16T04:08:51.488 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003890863 2024-09-16T04:08:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:61 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [append 0~344064,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.477155445999998, 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014009466, 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 61 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:08:51.492 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.492 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973871+0000", 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.42e-06 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974203+0000", 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000331649 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974215+0000", 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2428e-05 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.494 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974223+0000", 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4090000000000003e-06 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974499+0000", 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027562300000000001 2024-09-16T04:08:51.495 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974613+0000", 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011410500000000001 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.496 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.975669+0000", 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010556929999999999 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978426+0000", 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027567379999999999 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.497 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987790+0000", 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093645580000000003 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987879+0000", 2024-09-16T04:08:51.498 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8843000000000003e-05 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:62 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:08:51.499 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.476784277, 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01382477, 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.500 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 62 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.501 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.043e-06 2024-09-16T04:08:51.502 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974246+0000", 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7500000000000003e-06 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974255+0000", 2024-09-16T04:08:51.503 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6889999999999993e-06 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974262+0000", 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8020000000000003e-06 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.504 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976035+0000", 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001773513 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976098+0000", 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2561e-05 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.506 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.506 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976446+0000", 2024-09-16T04:08:51.506 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034762200000000001 2024-09-16T04:08:51.506 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.506 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.506 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.507 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978428+0000", 2024-09-16T04:08:51.507 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019825789999999999 2024-09-16T04:08:51.507 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.507 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.507 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.507 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987964+0000", 2024-09-16T04:08:51.508 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0095358739999999997 2024-09-16T04:08:51.508 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.508 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.508 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.508 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988065+0000", 2024-09-16T04:08:51.508 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101337 2024-09-16T04:08:51.509 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.509 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.509 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.509 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.509 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.510 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:63 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.510 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:51.510 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.476755894, 2024-09-16T04:08:51.510 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017999409000000001, 2024-09-16T04:08:51.510 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.510 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.511 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.511 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.511 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.511 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.511 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 63 2024-09-16T04:08:51.511 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.512 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.512 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.512 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.512 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:51.512 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.512 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.513 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.513 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.513 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:51.513 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.513 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.513 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.514 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.514 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:08:51.514 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0200000000000003e-07 2024-09-16T04:08:51.514 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.514 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.514 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.515 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974272+0000", 2024-09-16T04:08:51.515 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6450000000000001e-06 2024-09-16T04:08:51.515 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.515 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.515 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.516 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974280+0000", 2024-09-16T04:08:51.516 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3900000000000004e-06 2024-09-16T04:08:51.516 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.516 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.516 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.516 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974287+0000", 2024-09-16T04:08:51.517 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9410000000000007e-06 2024-09-16T04:08:51.517 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.517 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.517 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.517 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977414+0000", 2024-09-16T04:08:51.517 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031265419999999999 2024-09-16T04:08:51.518 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.518 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.518 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:51.518 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977505+0000", 2024-09-16T04:08:51.518 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0589999999999998e-05 2024-09-16T04:08:51.518 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.519 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.519 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.519 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988472+0000", 2024-09-16T04:08:51.519 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010967144999999999 2024-09-16T04:08:51.519 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.519 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.520 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.520 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988572+0000", 2024-09-16T04:08:51.520 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9774999999999999e-05 2024-09-16T04:08:51.520 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.520 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.521 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.521 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.992268+0000", 2024-09-16T04:08:51.521 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003696979 2024-09-16T04:08:51.521 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.521 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.522 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.522 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.522 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.522 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:123 3.3s0 3:cbefa139:::smithi20431790-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:51.522 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:51.522 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 34.405402197999997, 2024-09-16T04:08:51.523 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091212429999999994, 2024-09-16T04:08:51.523 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.523 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.523 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.523 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.523 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 123 2024-09-16T04:08:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.525 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:51.525 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.525 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.525 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.525 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.525 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:51.526 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.526 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.526 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.526 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.526 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:08:51.526 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0999999999999998e-07 2024-09-16T04:08:51.527 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.527 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.527 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.527 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045626+0000", 2024-09-16T04:08:51.527 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7360000000000001e-06 2024-09-16T04:08:51.527 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.528 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.528 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.528 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045634+0000", 2024-09-16T04:08:51.528 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.469e-06 2024-09-16T04:08:51.528 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.528 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.529 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.529 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045640+0000", 2024-09-16T04:08:51.529 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7340000000000002e-06 2024-09-16T04:08:51.529 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.529 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.529 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.530 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048271+0000", 2024-09-16T04:08:51.530 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026307589999999999 2024-09-16T04:08:51.530 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.530 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.530 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:51.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048353+0000", 2024-09-16T04:08:51.531 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2093000000000002e-05 2024-09-16T04:08:51.531 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.531 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053037+0000", 2024-09-16T04:08:51.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046837609999999998 2024-09-16T04:08:51.532 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.532 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.532 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.532 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053109+0000", 2024-09-16T04:08:51.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1594999999999995e-05 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.054744+0000", 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001635486 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.533 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:289 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.044898+0000", 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.406127476999998, 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0085620509999999993, 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 289 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044898+0000", 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044898+0000", 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044900+0000", 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4380000000000002e-06 2024-09-16T04:08:51.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044912+0000", 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1827e-05 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044939+0000", 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7223999999999999e-05 2024-09-16T04:08:51.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044951+0000", 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1608e-05 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045035+0000", 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4017999999999994e-05 2024-09-16T04:08:51.538 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045043+0000", 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0940000000000008e-06 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047198+0000", 2024-09-16T04:08:51.539 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0021557630000000002 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047307+0000", 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000108297 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.053460+0000", 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061527819999999999 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:290 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:08:51.541 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.406042028000002, 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092576150000000003, 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 290 2024-09-16T04:08:51.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:08:51.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044984+0000", 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0699999999999996e-07 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044990+0000", 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6370000000000002e-06 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.545 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045001+0000", 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0253e-05 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045008+0000", 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5179999999999998e-06 2024-09-16T04:08:51.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045111+0000", 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102534 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.547 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045116+0000", 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047750+0000", 2024-09-16T04:08:51.548 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026333289999999998 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047840+0000", 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0716000000000004e-05 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.549 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.550 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.550 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.054241+0000", 2024-09-16T04:08:51.550 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064002479999999999 2024-09-16T04:08:51.550 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.550 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.550 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.551 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.551 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:291 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:08:51.551 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:08:51.551 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 25.406005611000001, 2024-09-16T04:08:51.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010030295999999999, 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.552 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 291 2024-09-16T04:08:51.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.553 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:08:51.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.554 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045020+0000", 2024-09-16T04:08:51.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8100000000000003e-07 2024-09-16T04:08:51.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045024+0000", 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8580000000000002e-06 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045032+0000", 2024-09-16T04:08:51.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3310000000000004e-06 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045039+0000", 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6320000000000002e-06 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045164+0000", 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012537599999999999 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045172+0000", 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5750000000000003e-06 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048140+0000", 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029680029999999999 2024-09-16T04:08:51.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048205+0000", 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5269000000000001e-05 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.055050+0000", 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068446710000000001 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:307 3.3s0 3:c529a602:::smithi20431790-6:head [rollback 7] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 24.407848010999999, 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010861308, 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 307 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.560 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043180+0000", 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043196+0000", 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6101999999999999e-05 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043245+0000", 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8809e-05 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043270+0000", 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4379000000000002e-05 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043464+0000", 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019390799999999999 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043483+0000", 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9568999999999998e-05 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047345+0000", 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038619930000000002 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047636+0000", 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029135800000000002 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.054038+0000", 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064018399999999998 2024-09-16T04:08:51.564 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 20.594156364, 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010163948000000001, 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856870+0000", 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.297e-06 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856931+0000", 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0594000000000003e-05 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856960+0000", 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9413000000000001e-05 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856983+0000", 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2623e-05 2024-09-16T04:08:51.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857134+0000", 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015194899999999999 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857159+0000", 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4603000000000001e-05 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.866937+0000", 2024-09-16T04:08:51.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0097774980000000008 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867033+0000", 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5971000000000007e-05 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.bs3 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:08:51.569 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 20.59380397, 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0099345739999999998, 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857222+0000", 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.176e-06 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857325+0000", 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010283799999999999 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857351+0000", 2024-09-16T04:08:51.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6325999999999998e-05 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857371+0000", 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9854999999999999e-05 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857658+0000", 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000286347 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857684+0000", 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6879000000000001e-05 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867077+0000", 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093926080000000002 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867156+0000", 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8545000000000001e-05 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.573 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 20.593570036999999, 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012877899, 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857456+0000", 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.13e-06 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857497+0000", 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0889000000000001e-05 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857521+0000", 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3635999999999999e-05 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857630+0000", 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010979700000000001 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.860884+0000", 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032533760000000001 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.860915+0000", 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0966999999999997e-05 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870250+0000", 2024-09-16T04:08:51.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093347870000000006 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870333+0000", 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3317000000000002e-05 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.8s3 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 20.593171616999999, 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012440777, 2024-09-16T04:08:51.578 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857854+0000", 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.006e-06 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857909+0000", 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4805999999999997e-05 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857933+0000", 2024-09-16T04:08:51.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3468999999999998e-05 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857952+0000", 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9150000000000001e-05 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858117+0000", 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016526799999999999 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858143+0000", 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5887000000000001e-05 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870197+0000", 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012053927000000001 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870294+0000", 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7263999999999996e-05 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.582 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:523 3.3s0 3:cd6753c4:::smithi20431790-18:head [copy-from ver 6] snapc 10=[f] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 5.2526151920000004, 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014171206, 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 523 2024-09-16T04:08:51.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198413+0000", 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8449999999999999e-06 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198434+0000", 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0877e-05 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198483+0000", 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9058999999999999e-05 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198500+0000", 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7456999999999999e-05 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198657+0000", 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000157069 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198968+0000", 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00031080000000000002 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.208172+0000", 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092042619999999995 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.211163+0000", 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029903820000000002 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.212391+0000", 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001228385 2024-09-16T04:08:51.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.212581+0000", 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019007 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:524 3.3s0 3:cd6753c4:::smithi20431790-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 5.2524878069999996, 2024-09-16T04:08:51.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012231209, 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 524 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198538+0000", 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.237e-06 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198546+0000", 2024-09-16T04:08:51.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7149999999999998e-06 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198572+0000", 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5746999999999999e-05 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198585+0000", 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3339999999999999e-05 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.199477+0000", 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00089197600000000005 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.199599+0000", 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000122018 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210447+0000", 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010848116999999999 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210634+0000", 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018665899999999999 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210768+0000", 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013439999999999999 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:51.593 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:51.595 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:51.591+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:51.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:51.696 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:51.694+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:51.731 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:51.731 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:51.731 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:51.731 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:51.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:08:51.797 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:51.791+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:51.850 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.11 primary-affinity to 0.734102 (8481102) 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:252: done (1 left) 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:254: done (0 left) 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:255: read oid 11 snap -1 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:255: expect deleted 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:256: read oid 14 snap -1 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:256: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:51.852 INFO:tasks.rados.rados.0.smithi204.stdout:257: snap_create 2024-09-16T04:08:51.865 INFO:tasks.rados.rados.0.smithi204.stdout:256: expect (ObjNum 13 snap 0 seq_num 13) 2024-09-16T04:08:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:51.874 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:51.874 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:51.874 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:51.874 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:51.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:08:51.898 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:51.895+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:51.999 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:51.995+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:178 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'128, mlcod=25'125)", 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:52.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.457326608999999, 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040807439999999999, 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589373+0000", 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589375+0000", 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8059999999999999e-06 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589392+0000", 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7215e-05 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589423+0000", 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0893999999999999e-05 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589449+0000", 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6084e-05 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589544+0000", 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4752000000000004e-05 2024-09-16T04:08:52.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589575+0000", 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0914000000000003e-05 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593350+0000", 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037747520000000001 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593454+0000", 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010432700000000001 2024-09-16T04:08:52.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:179 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'129, mlcod=25'125)", 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.456879749000002, 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037140540000000001, 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589820+0000", 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589822+0000", 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5099999999999999e-06 2024-09-16T04:08:52.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589904+0000", 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1948999999999998e-05 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589932+0000", 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8768e-05 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.589950+0000", 2024-09-16T04:08:52.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7484999999999999e-05 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590036+0000", 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6421999999999994e-05 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590068+0000", 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1324e-05 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593460+0000", 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033925349999999999 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593534+0000", 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4060999999999994e-05 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:180 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'130, mlcod=25'125)", 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.456304359999997, 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048385040000000004, 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590397+0000", 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590411+0000", 2024-09-16T04:08:52.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4019000000000001e-05 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590437+0000", 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5604000000000001e-05 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590471+0000", 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786999999999997e-05 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590878+0000", 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040631400000000001 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590911+0000", 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595170+0000", 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042592050000000003 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595234+0000", 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3921e-05 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:181 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'131, mlcod=25'125)", 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.455899469999999, 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044790569999999998, 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590800+0000", 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590802+0000", 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5370000000000001e-06 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590815+0000", 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2622e-05 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590841+0000", 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5914999999999998e-05 2024-09-16T04:08:52.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590857+0000", 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6430999999999999e-05 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591464+0000", 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060738700000000003 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591494+0000", 2024-09-16T04:08:52.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9467000000000001e-05 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595239+0000", 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037453709999999999 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595279+0000", 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0327000000000002e-05 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:182 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'132, mlcod=25'125)", 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.455390524999999, 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051456440000000004, 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591311+0000", 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7439999999999999e-06 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591380+0000", 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8540000000000004e-05 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591407+0000", 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7830999999999998e-05 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591427+0000", 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9689000000000001e-05 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592031+0000", 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060361900000000001 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592059+0000", 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8603999999999999e-05 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596398+0000", 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043381060000000004 2024-09-16T04:08:52.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596455+0000", 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7510999999999999e-05 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:183 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'133, mlcod=25'125)", 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.454888554999997, 2024-09-16T04:08:52.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046844299999999998, 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591813+0000", 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5990000000000001e-06 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591827+0000", 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4012000000000001e-05 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591851+0000", 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3785e-05 2024-09-16T04:08:52.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591867+0000", 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6184999999999998e-05 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592788+0000", 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092107500000000004 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592818+0000", 2024-09-16T04:08:52.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0487000000000001e-05 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596460+0000", 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036418240000000001 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596496+0000", 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5463000000000002e-05 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:184 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'134, mlcod=25'126)", 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.454055849, 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039075459999999996, 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:52.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592644+0000", 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592646+0000", 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5689999999999999e-06 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592687+0000", 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0890000000000003e-05 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592714+0000", 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7433999999999999e-05 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592752+0000", 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7703000000000001e-05 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593624+0000", 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087221300000000005 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593657+0000", 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596500+0000", 2024-09-16T04:08:52.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028428279999999999 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596552+0000", 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1755000000000002e-05 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:185 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'135, mlcod=25'126)", 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:52.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.453490053000003, 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004807703, 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:08:52.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593211+0000", 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593283+0000", 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1697000000000002e-05 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593310+0000", 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7427999999999999e-05 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593326+0000", 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6121e-05 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594218+0000", 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089172399999999999 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594251+0000", 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3093999999999999e-05 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597952+0000", 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037006389999999999 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598018+0000", 2024-09-16T04:08:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5640000000000002e-05 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:186 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'136, mlcod=25'126)", 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.452978139000002, 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043516780000000003, 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593722+0000", 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593723+0000", 2024-09-16T04:08:52.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.674e-06 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593735+0000", 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1844999999999999e-05 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593766+0000", 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0491e-05 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593785+0000", 2024-09-16T04:08:52.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9585e-05 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595361+0000", 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015760870000000001 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595391+0000", 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9974000000000001e-05 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598023+0000", 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00263138 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598073+0000", 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0642000000000001e-05 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:187 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'137, mlcod=25'126)", 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:52.091 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.452589535999998, 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040215060000000002, 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594110+0000", 2024-09-16T04:08:52.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594112+0000", 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594125+0000", 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2928000000000001e-05 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594151+0000", 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5860999999999999e-05 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594167+0000", 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6458999999999999e-05 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595892+0000", 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017252299999999999 2024-09-16T04:08:52.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595937+0000", 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4246000000000003e-05 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598075+0000", 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002138821 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598132+0000", 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6461e-05 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.106121432000002, 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055770669999999998, 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940579+0000", 2024-09-16T04:08:52.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7e-07 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940742+0000", 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343299999999999 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940766+0000", 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3288000000000001e-05 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940779+0000", 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3254999999999999e-05 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0068000000000007e-05 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940868+0000", 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8170000000000005e-06 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946112+0000", 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052441359999999999 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946156+0000", 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3600000000000003e-05 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.105890367999997, 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047930250000000002, 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940832+0000", 2024-09-16T04:08:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1430999999999999e-05 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940851+0000", 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8941e-05 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9100000000000005e-06 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940937+0000", 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8448999999999994e-05 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940947+0000", 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.012e-05 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945554+0000", 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046069070000000004 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945603+0000", 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8401e-05 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:52.105 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.105169601, 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046535999999999999, 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941531+0000", 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.127e-06 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941561+0000", 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0011000000000001e-05 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941630+0000", 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8071999999999995e-05 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941642+0000", 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2785e-05 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941714+0000", 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1396000000000006e-05 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941729+0000", 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5656999999999999e-05 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946160+0000", 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044310349999999998 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946184+0000", 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3516999999999999e-05 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.104450374000002, 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039380309999999998, 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.110 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942250+0000", 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942275+0000", 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4142999999999999e-05 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942290+0000", 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4929000000000001e-05 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942299+0000", 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8190000000000003e-06 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942409+0000", 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109419 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.942417+0000", 2024-09-16T04:08:52.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539999999999992e-06 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946142+0000", 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037254079999999999 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946188+0000", 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5123999999999997e-05 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.114 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.193212535000001, 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049795229999999996, 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853488+0000", 2024-09-16T04:08:52.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853542+0000", 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3414000000000001e-05 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853571+0000", 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9356000000000002e-05 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853593+0000", 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2022e-05 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853710+0000", 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011686199999999999 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853729+0000", 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9042000000000002e-05 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856355+0000", 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026263950000000001 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858467+0000", 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021115890000000001 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.191344000000001, 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060930639999999996, 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:52.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5199999999999998e-07 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855382+0000", 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6024e-05 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855395+0000", 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2721000000000001e-05 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855403+0000", 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4849999999999992e-06 2024-09-16T04:08:52.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858436+0000", 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003033011 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858471+0000", 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4548999999999997e-05 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.861417+0000", 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002946228 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.861449+0000", 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1794000000000001e-05 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 63/31 ECSubWrite(tid=130, reqid=client.4631.0:534, at_version=63'44, trim_to=0'0, roll_forward_to=63'42))", 2024-09-16T04:08:52.124 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.387528+0000", 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6591719969999996, 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004958662, 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387528+0000", 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387528+0000", 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387555+0000", 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7285e-05 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387593+0000", 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7512999999999998e-05 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387614+0000", 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1375000000000001e-05 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387628+0000", 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3427e-05 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387753+0000", 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125943 2024-09-16T04:08:52.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387768+0000", 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4136e-05 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.392361+0000", 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045937729999999998 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.392487+0000", 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012521 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.ds2 63/31 ECSubWrite(tid=131, reqid=client.4631.0:537, at_version=63'15, trim_to=0'0, roll_forward_to=62'13))", 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.389358+0000", 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6573415550000004, 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046425249999999998, 2024-09-16T04:08:52.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389358+0000", 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389358+0000", 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389360+0000", 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-06 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389405+0000", 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5488999999999998e-05 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389439+0000", 2024-09-16T04:08:52.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4038999999999997e-05 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389462+0000", 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2342999999999999e-05 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389673+0000", 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021117 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.389700+0000", 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6533000000000002e-05 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.393905+0000", 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042056139999999999 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.394001+0000", 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5754000000000005e-05 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 64/31 ECSubWrite(tid=136, reqid=osd.13.0:136, at_version=64'48, trim_to=0'0, roll_forward_to=63'46))", 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.904491+0000", 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.1422086059999996, 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048433909999999998, 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904491+0000", 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904491+0000", 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904493+0000", 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.708e-06 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904524+0000", 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0725999999999997e-05 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904549+0000", 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5117999999999999e-05 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904561+0000", 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1864e-05 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904651+0000", 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904665+0000", 2024-09-16T04:08:52.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.473e-05 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.909290+0000", 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046243029999999997 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.909335+0000", 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5065999999999998e-05 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.ds2 64/31 ECSubWrite(tid=137, reqid=osd.13.0:137, at_version=64'17, trim_to=0'0, roll_forward_to=63'15))", 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.904605+0000", 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.1420948490000002, 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037964320000000002, 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904605+0000", 2024-09-16T04:08:52.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904605+0000", 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904605+0000", 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.36e-07 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904634+0000", 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9132000000000002e-05 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904646+0000", 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1935e-05 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904653+0000", 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5490000000000003e-06 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904753+0000", 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100008 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904768+0000", 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4854e-05 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.908354+0000", 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035857969999999999 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.908401+0000", 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7920999999999997e-05 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.143 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:52.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:08:52.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:52.142+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:52.246 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:52.240+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:52.276 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:52.276 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:52.276 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:52.276 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:52.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:08:52.346 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:52.346+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:52.409 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:52.409 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:52.409 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:52.409 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:52.409 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:52.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:08:52.447 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:52.444+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:52.548 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:52.544+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:52.555 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:52.555 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:4, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.934199+0000", 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.61801062, 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020115319999999999, 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934199+0000", 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934199+0000", 2024-09-16T04:08:52.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934201+0000", 2024-09-16T04:08:52.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7099999999999999e-06 2024-09-16T04:08:52.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934288+0000", 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7287999999999995e-05 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934353+0000", 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4323000000000001e-05 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934381+0000", 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8351999999999999e-05 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934782+0000", 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040130899999999998 2024-09-16T04:08:52.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934823+0000", 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0964999999999998e-05 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936121+0000", 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012980299999999999 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.936211+0000", 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9555000000000006e-05 2024-09-16T04:08:52.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=20, reqid=client.4631.0:188, at_version=39'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.553944232999999, 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040184299999999999, 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.562 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2300000000000001e-07 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998524+0000", 2024-09-16T04:08:52.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000257564 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998556+0000", 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990999999999999e-05 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998574+0000", 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7768999999999999e-05 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998779+0000", 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020545399999999999 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998807+0000", 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7620999999999999e-05 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002192+0000", 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033852890000000001 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002284+0000", 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2119000000000004e-05 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=21, reqid=client.4631.0:189, at_version=39'7, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.549401177, 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032263890000000001, 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.567 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002810+0000", 2024-09-16T04:08:52.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.736e-06 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003033+0000", 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022254499999999999 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003074+0000", 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1038000000000002e-05 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003098+0000", 2024-09-16T04:08:52.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3805999999999999e-05 2024-09-16T04:08:52.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003258+0000", 2024-09-16T04:08:52.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016002799999999999 2024-09-16T04:08:52.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003292+0000", 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4155000000000001e-05 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005933+0000", 2024-09-16T04:08:52.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026408299999999998 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006035+0000", 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010225099999999999 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.573 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=23, reqid=client.4631.0:190, at_version=0'0, trim_to=0'0, roll_forward_to=39'8))", 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:22.010002+0000", 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.542208172999999, 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00191584, 2024-09-16T04:08:52.574 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.575 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.575 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.575 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010002+0000", 2024-09-16T04:08:52.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010002+0000", 2024-09-16T04:08:52.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010004+0000", 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.877e-06 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010031+0000", 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7864999999999998e-05 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010074+0000", 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2104000000000002e-05 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010092+0000", 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8219e-05 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010256+0000", 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016385600000000001 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010286+0000", 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0037999999999999e-05 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.011800+0000", 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015143240000000001 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.011918+0000", 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117557 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.580 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 44/31 ECSubWrite(tid=48, reqid=client.4631.0:302, at_version=44'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:27.041593+0000", 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.510616509999998, 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025847079999999998, 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041593+0000", 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041593+0000", 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041594+0000", 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8599999999999999e-07 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.041997+0000", 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040302300000000002 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042017+0000", 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0505000000000001e-05 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042030+0000", 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.238e-05 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042760+0000", 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073047900000000002 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.042771+0000", 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.066e-05 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.044123+0000", 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013526429999999999 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:27.044178+0000", 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4632000000000001e-05 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.698134209999999, 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020743480000000002, 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854076+0000", 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8999999999999996e-07 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854151+0000", 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4530000000000006e-05 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854184+0000", 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2888000000000001e-05 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854207+0000", 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2806000000000002e-05 2024-09-16T04:08:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854390+0000", 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018299200000000001 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854407+0000", 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7646e-05 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856057+0000", 2024-09-16T04:08:52.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016492970000000001 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856150+0000", 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3498999999999994e-05 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854455+0000", 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.697754542999999, 2024-09-16T04:08:52.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034971920000000001, 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854455+0000", 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854455+0000", 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854456+0000", 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6700000000000003e-07 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854509+0000", 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3204000000000001e-05 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854539+0000", 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9606000000000001e-05 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854560+0000", 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0576000000000001e-05 2024-09-16T04:08:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854824+0000", 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026413499999999998 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854850+0000", 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6486e-05 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.857902+0000", 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00305193 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.857953+0000", 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0488000000000002e-05 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 59/31 ECSubWrite(tid=85, reqid=client.4631.0:467, at_version=59'28, trim_to=0'0, roll_forward_to=57'26))", 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:41.855085+0000", 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.697124917, 2024-09-16T04:08:52.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002088852, 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855085+0000", 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855085+0000", 2024-09-16T04:08:52.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855086+0000", 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0999999999999998e-07 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855157+0000", 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1453999999999997e-05 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855184+0000", 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7246e-05 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855220+0000", 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5422000000000001e-05 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855424+0000", 2024-09-16T04:08:52.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000204358 2024-09-16T04:08:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.855443+0000", 2024-09-16T04:08:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8919999999999998e-05 2024-09-16T04:08:52.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.857070+0000", 2024-09-16T04:08:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016274219999999999 2024-09-16T04:08:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.857174+0000", 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010342 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.601 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 59/31 ECSubWrite(tid=87, reqid=client.4631.0:469, at_version=59'30, trim_to=0'0, roll_forward_to=57'26))", 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:41.861444+0000", 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.690765483, 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038315290000000002, 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861444+0000", 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861444+0000", 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861446+0000", 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.404e-06 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861493+0000", 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7317000000000001e-05 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861518+0000", 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5066999999999999e-05 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861532+0000", 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3702e-05 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861628+0000", 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5650999999999996e-05 2024-09-16T04:08:52.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861646+0000", 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8264999999999999e-05 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865225+0000", 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035794749999999999 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865276+0000", 2024-09-16T04:08:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0648e-05 2024-09-16T04:08:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 59/31 ECSubWrite(tid=105, reqid=client.4631.0:472, at_version=59'29, trim_to=0'0, roll_forward_to=54'27))", 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:41.862248+0000", 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.689961679, 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029572320000000002, 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.607 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.862248+0000", 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.862248+0000", 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.862249+0000", 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7800000000000002e-07 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.862285+0000", 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6766e-05 2024-09-16T04:08:52.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.862306+0000", 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0888000000000001e-05 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.862320+0000", 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3360000000000001e-05 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.863027+0000", 2024-09-16T04:08:52.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070705099999999999 2024-09-16T04:08:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.863035+0000", 2024-09-16T04:08:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6770000000000001e-06 2024-09-16T04:08:52.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865149+0000", 2024-09-16T04:08:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021134579999999999 2024-09-16T04:08:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865205+0000", 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6653999999999997e-05 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 60/31 ECSubWrite(tid=39, reqid=osd.8.0:39, at_version=60'27, trim_to=0'0, roll_forward_to=57'25))", 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:42.883250+0000", 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6689597589999998, 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030009020000000002, 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883250+0000", 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883250+0000", 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883251+0000", 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4e-07 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883311+0000", 2024-09-16T04:08:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0134999999999999e-05 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883346+0000", 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4968999999999997e-05 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883373+0000", 2024-09-16T04:08:52.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6475999999999999e-05 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883643+0000", 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027061499999999998 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.883673+0000", 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0256e-05 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886214+0000", 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025407139999999999 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886251+0000", 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6897000000000003e-05 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 60/31 ECSubWrite(tid=111, reqid=osd.13.0:111, at_version=60'33, trim_to=0'0, roll_forward_to=59'31))", 2024-09-16T04:08:52.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:42.886590+0000", 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6656203250000008, 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018906490000000001, 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886590+0000", 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886590+0000", 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886590+0000", 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.54e-07 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886647+0000", 2024-09-16T04:08:52.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6798000000000001e-05 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886679+0000", 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2042999999999998e-05 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886710+0000", 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0794999999999999e-05 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886833+0000", 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122531 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.886843+0000", 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0729e-05 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.888447+0000", 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016040430000000001 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.888480+0000", 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2855999999999998e-05 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/31 ECSubWrite(tid=89, reqid=osd.5.0:89, at_version=60'32, trim_to=0'0, roll_forward_to=59'30))", 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:42.891360+0000", 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6608498479999998, 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038300119999999998, 2024-09-16T04:08:52.623 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891360+0000", 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891360+0000", 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891361+0000", 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.37e-07 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891416+0000", 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4938000000000002e-05 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891445+0000", 2024-09-16T04:08:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8958999999999998e-05 2024-09-16T04:08:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891467+0000", 2024-09-16T04:08:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2480000000000002e-05 2024-09-16T04:08:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891573+0000", 2024-09-16T04:08:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106122 2024-09-16T04:08:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.891586+0000", 2024-09-16T04:08:52.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2328e-05 2024-09-16T04:08:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.895110+0000", 2024-09-16T04:08:52.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035243240000000001 2024-09-16T04:08:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.895190+0000", 2024-09-16T04:08:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0223999999999996e-05 2024-09-16T04:08:52.631 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.632 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/31 ECSubWrite(tid=90, reqid=osd.5.0:90, at_version=60'34, trim_to=0'0, roll_forward_to=59'30))", 2024-09-16T04:08:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:42.893901+0000", 2024-09-16T04:08:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6583090019999993, 2024-09-16T04:08:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021330500000000001, 2024-09-16T04:08:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.633 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.893901+0000", 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.893901+0000", 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.893903+0000", 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9099999999999999e-06 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.893958+0000", 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5544000000000002e-05 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.893990+0000", 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1869000000000003e-05 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.894013+0000", 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2359000000000001e-05 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.894225+0000", 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021221099999999999 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.894251+0000", 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6605999999999999e-05 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.895946+0000", 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016948410000000001 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:42.896034+0000", 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7709999999999999e-05 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 63/31 ECSubWrite(tid=110, reqid=client.4631.0:509, at_version=63'54, trim_to=0'0, roll_forward_to=63'53))", 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.176492+0000", 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.3757176170000003, 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057347099999999996, 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.638 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.176492+0000", 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.176492+0000", 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.176496+0000", 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4759999999999998e-06 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178480+0000", 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019841189999999999 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178518+0000", 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8482000000000002e-05 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178537+0000", 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8892000000000001e-05 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178731+0000", 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019350500000000001 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178756+0000", 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5686000000000001e-05 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.182095+0000", 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033381470000000001 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.182227+0000", 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013240300000000001 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 63/31 ECSubWrite(tid=44, reqid=client.4631.0:523, at_version=63'29, trim_to=0'0, roll_forward_to=42'26))", 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.208539+0000", 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.3436709330000003, 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00254864, 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.643 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208539+0000", 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208539+0000", 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208539+0000", 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.27e-07 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208741+0000", 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000202105 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208770+0000", 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8904999999999999e-05 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208786+0000", 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5823000000000001e-05 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208914+0000", 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128353 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.208934+0000", 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9063e-05 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.210997+0000", 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020630459999999998 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.211088+0000", 2024-09-16T04:08:52.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1018000000000002e-05 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 64/31 ECSubWrite(tid=112, reqid=osd.5.0:112, at_version=64'56, trim_to=0'0, roll_forward_to=63'54))", 2024-09-16T04:08:52.648 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.900150+0000", 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6520599520000001, 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001990346, 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900150+0000", 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900150+0000", 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900150+0000", 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000001e-07 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900197+0000", 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7150000000000001e-05 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900224+0000", 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6597999999999998e-05 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900241+0000", 2024-09-16T04:08:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7373000000000001e-05 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900362+0000", 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120096 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.900379+0000", 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7744000000000002e-05 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.902088+0000", 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017082250000000001 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.902140+0000", 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2772999999999998e-05 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 64/31 ECSubWrite(tid=113, reqid=osd.5.0:113, at_version=64'58, trim_to=0'0, roll_forward_to=63'54))", 2024-09-16T04:08:52.653 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.901372+0000", 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6508379959999999, 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019310919999999999, 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901372+0000", 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901372+0000", 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901373+0000", 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1310000000000001e-06 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901419+0000", 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5785999999999998e-05 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901467+0000", 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7936999999999999e-05 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901478+0000", 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1239e-05 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901610+0000", 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013177499999999999 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.901624+0000", 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4182000000000001e-05 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.903252+0000", 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001627636 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.903303+0000", 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1406000000000002e-05 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 64/31 ECSubWrite(tid=56, reqid=client.4631.0:554, at_version=64'38, trim_to=0'0, roll_forward_to=64'37))", 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.020754+0000", 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5314554679999999, 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835918, 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020754+0000", 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020754+0000", 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020755+0000", 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3099999999999997e-07 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020905+0000", 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014950799999999999 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020921+0000", 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6413e-05 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020929+0000", 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.021301+0000", 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371257 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.021313+0000", 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2723e-05 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.022555+0000", 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001241806 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.022590+0000", 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5234000000000002e-05 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s6 65/31 ECSubWrite(tid=292, reqid=client.4631.0:566, at_version=65'32, trim_to=0'0, roll_forward_to=64'30))", 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.933089+0000", 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.6191209000000004, 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002763869, 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933089+0000", 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933089+0000", 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933089+0000", 2024-09-16T04:08:52.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000002e-07 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933785+0000", 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069539700000000005 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933803+0000", 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8162999999999999e-05 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933813+0000", 2024-09-16T04:08:52.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.011e-05 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933894+0000", 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1148000000000003e-05 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.933905+0000", 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0533000000000001e-05 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:52.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.935809+0000", 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001904263 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.935853+0000", 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3998999999999997e-05 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:52.666 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:52.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:08:52.668 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:52.664+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:52.769 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:52.767+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:52.798 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:52.798 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:52.798 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:52.798 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:52.813 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:08:52.854 INFO:tasks.rados.rados.0.smithi204.stdout:255: done (2 left) 2024-09-16T04:08:52.854 INFO:tasks.rados.rados.0.smithi204.stdout:256: done (1 left) 2024-09-16T04:08:52.854 INFO:tasks.rados.rados.0.smithi204.stdout:257: done (0 left) 2024-09-16T04:08:52.855 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 9 current snap is 19 2024-09-16T04:08:52.855 INFO:tasks.rados.rados.0.smithi204.stdout:258: seq_num 113 ranges {147456=737280,884736=557056,1441792=606208} 2024-09-16T04:08:52.868 INFO:tasks.rados.rados.0.smithi204.stdout:258: writing smithi20431790-9 from 147456 to 884736 tid 1 2024-09-16T04:08:52.869 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:52.863+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:52.877 INFO:tasks.rados.rados.0.smithi204.stdout:258: writing smithi20431790-9 from 884736 to 1441792 tid 2 2024-09-16T04:08:52.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-16T04:08:52.887 INFO:tasks.rados.rados.0.smithi204.stdout:258: writing smithi20431790-9 from 1441792 to 2048000 tid 3 2024-09-16T04:08:52.887 INFO:tasks.rados.rados.0.smithi204.stdout:259: setattr oid 46 current snap is 19 2024-09-16T04:08:52.887 INFO:tasks.rados.rados.0.smithi204.stdout:258: finishing write tid 1 to smithi20431790-9 2024-09-16T04:08:52.887 INFO:tasks.rados.rados.0.smithi204.stdout:258: finishing write tid 2 to smithi20431790-9 2024-09-16T04:08:52.890 INFO:tasks.rados.rados.0.smithi204.stdout:260: snap_create 2024-09-16T04:08:52.894 INFO:tasks.rados.rados.0.smithi204.stdout:258: finishing write tid 3 to smithi20431790-9 2024-09-16T04:08:52.895 INFO:tasks.rados.rados.0.smithi204.stdout:258: finishing write tid 4 to smithi20431790-9 2024-09-16T04:08:52.899 INFO:tasks.rados.rados.0.smithi204.stdout:258: finishing write tid 5 to smithi20431790-9 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:258: oid 9 updating version 0 to 39 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:258: oid 9 version 39 is already newer than 36 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:258: oid 9 version 39 is already newer than 37 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:258: oid 9 version 39 is already newer than 38 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 9 v 39 (ObjNum 113 snap 19 seq_num 113) dirty exists 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:258: left oid 9 (ObjNum 113 snap 19 seq_num 113) 2024-09-16T04:08:52.900 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 46 v 35 (ObjNum 161 snap 0 seq_num 1474560616) dirty exists 2024-09-16T04:08:52.940 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:52.940 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:52.940 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:52.940 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:52.940 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:52.956 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:08:53.006 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:53.005+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:53.071 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:08:53.067+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:4 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~32768,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:08:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.147765520999997, 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013185643, 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 4 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:08:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932527+0000", 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8419999999999999e-06 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932624+0000", 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6569000000000003e-05 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932639+0000", 2024-09-16T04:08:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5235000000000001e-05 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932649+0000", 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9170000000000001e-06 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932741+0000", 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2386999999999995e-05 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932935+0000", 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019349300000000001 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933686+0000", 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000751397 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935325+0000", 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016391139999999999 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945629+0000", 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010304015999999999 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945711+0000", 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1673000000000002e-05 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:5 3.es0 3:7eb60d01:::smithi20431790-2:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.147613560000003, 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023042435, 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 5 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932678+0000", 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3900000000000005e-07 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932681+0000", 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9380000000000001e-06 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932688+0000", 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0190000000000001e-06 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932693+0000", 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0470000000000001e-06 2024-09-16T04:08:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934299+0000", 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016061459999999999 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934403+0000", 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104053 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934949+0000", 2024-09-16T04:08:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054629899999999998 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.937424+0000", 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024750050000000002 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955463+0000", 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018038200000000001 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955720+0000", 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025718900000000001 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:6 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.147569075, 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033670261999999999, 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 6 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.15e-07 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932731+0000", 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5450000000000003e-06 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932738+0000", 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7630000000000003e-06 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932743+0000", 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.13e-06 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935222+0000", 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002479621 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935313+0000", 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0717999999999994e-05 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956695+0000", 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021382437000000001 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956983+0000", 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028708299999999999 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966392+0000", 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094095499999999992 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 33/31 ECSubWrite(tid=1, reqid=client.4631.0:13, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.941481+0000", 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.138809471999998, 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005447782, 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941481+0000", 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941481+0000", 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941482+0000", 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1800000000000001e-07 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.944725+0000", 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032427620000000002 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945764+0000", 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010393379999999999 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945777+0000", 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2911999999999999e-05 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945904+0000", 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126859 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945915+0000", 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0964999999999999e-05 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946885+0000", 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097043599999999998 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946929+0000", 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4091999999999997e-05 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:139 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~786432,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.004567881, 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067777820000000004, 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075725+0000", 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.807e-06 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077516+0000", 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017915439999999999 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077542+0000", 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6095999999999999e-05 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077554+0000", 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1092e-05 2024-09-16T04:08:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077624+0000", 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9941e-05 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077802+0000", 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017843199999999999 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.079111+0000", 2024-09-16T04:08:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00130955 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081291+0000", 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00217986 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082420+0000", 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001128642 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082501+0000", 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0817999999999998e-05 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:140 3.es0 3:7eff5f99:::smithi20431790-47:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.077585+0000", 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.002705470000002, 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060159829999999999, 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077585+0000", 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077585+0000", 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077587+0000", 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.082e-06 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077592+0000", 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0730000000000004e-06 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077601+0000", 2024-09-16T04:08:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3300000000000005e-06 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077608+0000", 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6039999999999998e-06 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080365+0000", 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027578220000000001 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080479+0000", 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011374699999999999 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.080985+0000", 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050615199999999995 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082773+0000", 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017874399999999999 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083515+0000", 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074210900000000002 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083601+0000", 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6624000000000003e-05 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:141 3.es0 3:7eff5f99:::smithi20431790-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.002672680000003, 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077419300000000002, 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077619+0000", 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1200000000000003e-07 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077622+0000", 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5599999999999998e-06 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077630+0000", 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7719999999999994e-06 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077636+0000", 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4689999999999996e-06 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081205+0000", 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003569773 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081284+0000", 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8584000000000005e-05 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083920+0000", 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026361890000000002 2024-09-16T04:08:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.084003+0000", 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2714999999999997e-05 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.085360+0000", 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013573560000000001 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as4 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.854166+0000", 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.226124448, 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047152909999999999, 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854166+0000", 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854166+0000", 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854167+0000", 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8099999999999999e-07 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854197+0000", 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0652999999999999e-05 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854214+0000", 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6880000000000001e-05 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854227+0000", 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2356e-05 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854789+0000", 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056211599999999998 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.854803+0000", 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4615e-05 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858829+0000", 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00402572 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858882+0000", 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2670000000000002e-05 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(osd.13.22:3 3.es0 3:7eff5f99:::smithi20431790-47:head [copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:41.860832+0000", 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 11.219459154000001, 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046069489999999999, 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860832+0000", 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860832+0000", 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860834+0000", 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2199999999999999e-06 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860844+0000", 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0026e-05 2024-09-16T04:08:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860858+0000", 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3585e-05 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860868+0000", 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860953+0000", 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5154000000000005e-05 2024-09-16T04:08:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.860961+0000", 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3259999999999998e-06 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865130+0000", 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041694059999999996 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865439+0000", 2024-09-16T04:08:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030851199999999999 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:506 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~2637824,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.159225+0000", 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9210656539999995, 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013121979000000001, 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 506 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159225+0000", 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159225+0000", 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159229+0000", 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.63e-06 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159249+0000", 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0193000000000001e-05 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159287+0000", 2024-09-16T04:08:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7945999999999999e-05 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159307+0000", 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9695e-05 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159513+0000", 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020604799999999999 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159831+0000", 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031844799999999998 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172347+0000", 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012516019 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:507 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~2637824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:08:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9209293870000002, 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015605647, 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:08:53.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5600000000000004e-07 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159388+0000", 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5321e-05 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159401+0000", 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2746e-05 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159408+0000", 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1300000000000003e-06 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.161079+0000", 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016716089999999999 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.161364+0000", 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028476800000000002 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.174967+0000", 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013603117 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:508 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~2637824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.159463+0000", 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9208277779999996, 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018372958000000002, 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.138 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 508 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159463+0000", 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159463+0000", 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159464+0000", 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2800000000000005e-07 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159481+0000", 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7280000000000001e-05 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159496+0000", 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159503+0000", 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0380000000000002e-06 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.162481+0000", 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029773209999999998 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.162631+0000", 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014984199999999999 2024-09-16T04:08:53.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.177836+0000", 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015205582 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpReadReply(3.es0 63/31 ECSubReadReply(tid=51, attrs_read=0))", 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.169866+0000", 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9104251960000003, 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052314279999999998, 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.142 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.169866+0000", 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.169866+0000", 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.169867+0000", 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.077e-06 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171072+0000", 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00120481 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171105+0000", 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2962000000000001e-05 2024-09-16T04:08:53.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171123+0000", 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7997000000000001e-05 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172539+0000", 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00141676 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.175097+0000", 2024-09-16T04:08:53.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002557822 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpReadReply(3.es0 63/31 ECSubReadReply(tid=52, attrs_read=0))", 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.171161+0000", 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9091301549999997, 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068944330000000002, 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:08:53.146 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171161+0000", 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171161+0000", 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171162+0000", 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1629999999999999e-06 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172065+0000", 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00090283799999999999 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172090+0000", 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5579999999999999e-05 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172106+0000", 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5843000000000001e-05 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.175165+0000", 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030583709999999998 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178055+0000", 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028906380000000001 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:552 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~540672] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.011159+0000", 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.0691316559999997, 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064583230000000002, 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.150 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 552 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.011159+0000", 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.011159+0000", 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.011162+0000", 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3350000000000001e-06 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.012048+0000", 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088603599999999999 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.012072+0000", 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3955999999999999e-05 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.012083+0000", 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.19e-05 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.012157+0000", 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3910000000000002e-05 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.012226+0000", 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8348000000000004e-05 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.012882+0000", 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065579500000000003 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.014377+0000", 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014954149999999999 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.017515+0000", 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00313839 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.017618+0000", 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010223800000000001 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.155 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:553 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~507904] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.014475+0000", 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.0658162659999997, 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049366330000000002, 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 553 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.014475+0000", 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.014475+0000", 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.014477+0000", 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8059999999999999e-06 2024-09-16T04:08:53.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.015477+0000", 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099959700000000007 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.015517+0000", 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9688999999999999e-05 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.015539+0000", 2024-09-16T04:08:53.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2002999999999999e-05 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.015639+0000", 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010022 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.015721+0000", 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2075000000000003e-05 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.016406+0000", 2024-09-16T04:08:53.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068509899999999999 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.017633+0000", 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001227243 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019350+0000", 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017162499999999999 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019411+0000", 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1650999999999996e-05 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:554 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~622592] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.018597+0000", 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.0616934459999996, 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062012990000000004, 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.161 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 554 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.018597+0000", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.018597+0000", 2024-09-16T04:08:53.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.018599+0000", 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.043e-06 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019365+0000", 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076685999999999996 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019374+0000", 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8179999999999993e-06 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019384+0000", 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7869999999999996e-06 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019807+0000", 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042298800000000001 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019908+0000", 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010061899999999999 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.020696+0000", 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078888899999999997 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024095+0000", 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033980519999999999 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024747+0000", 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065242200000000005 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024799+0000", 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1820999999999997e-05 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:555 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~32768] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.019397+0000", 2024-09-16T04:08:53.166 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.0608942460000002, 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057399169999999998, 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 555 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019397+0000", 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019397+0000", 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019397+0000", 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7700000000000004e-07 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019418+0000", 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0577e-05 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019436+0000", 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7486000000000002e-05 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019440+0000", 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7419999999999997e-06 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.021176+0000", 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001735833 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.021292+0000", 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115561 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.021804+0000", 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051260800000000001 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024097+0000", 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022927289999999999 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.025090+0000", 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099274299999999992 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.025137+0000", 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6860999999999997e-05 2024-09-16T04:08:53.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:556 3.es0 3:7eb60d01:::smithi20431790-2:head [setxattr _header (56) in=7b] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.019448+0000", 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.0608428310000004, 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085764510000000006, 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.172 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 556 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019448+0000", 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019448+0000", 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019449+0000", 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3300000000000002e-07 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019451+0000", 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1720000000000001e-06 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019455+0000", 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3800000000000004e-06 2024-09-16T04:08:53.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019458+0000", 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0989999999999999e-06 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.022961+0000", 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035028239999999999 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.023114+0000", 2024-09-16T04:08:53.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015293899999999999 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.023706+0000", 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059239899999999996 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024443+0000", 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073647000000000003 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.027948+0000", 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003504708 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.028025+0000", 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6927000000000004e-05 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:557 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.019462+0000", 2024-09-16T04:08:53.177 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.0608284230000002, 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010162885999999999, 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 557 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019462+0000", 2024-09-16T04:08:53.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019462+0000", 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019463+0000", 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.84e-07 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019464+0000", 2024-09-16T04:08:53.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1990000000000001e-06 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019468+0000", 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1969999999999998e-06 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019472+0000", 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9450000000000003e-06 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.023993+0000", 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045205260000000004 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024085+0000", 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1988000000000001e-05 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.028323+0000", 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042385749999999996 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.028408+0000", 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4679999999999996e-05 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.029625+0000", 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012174919999999999 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.182 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:53.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:08:53.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:53.178+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:53.284 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:53.283+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:53.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:53.357 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:53.357 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:53.357 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:08:53.357 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:53.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:08:53.418 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:53.417+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:53.469 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:53.470 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:53.486 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:53.484+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:53.491 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:53.491 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:53.513 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:53.514 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:53.536 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:53.536 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:53.543 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:53.543 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:08:53.544 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:08:53.544 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:08:53.544 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:53.555 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:53.555 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:53.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:08:53.578 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:53.578 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:53.587 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:53.584+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:53.600 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:53.601 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:53.623 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:53.623 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:53.642 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:53.642 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:53.664 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:53.665 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:31 3.9s0 3:93634e21:::smithi20431790-11:head [append 0~180224,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.728348789000002, 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015779225000000001, 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 31 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947688+0000", 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.599e-06 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948028+0000", 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000340491 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948040+0000", 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1488000000000001e-05 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948046+0000", 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948165+0000", 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011934000000000001 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948369+0000", 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020333999999999999 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949522+0000", 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001153435 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951355+0000", 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001833386 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963404+0000", 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012048644000000001 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963464+0000", 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0044999999999999e-05 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:32 3.9s0 3:93634e21:::smithi20431790-11:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.727966098000003, 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015702510999999999, 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 32 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2600000000000002e-07 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948073+0000", 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6700000000000002e-06 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948082+0000", 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-06 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948090+0000", 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9729999999999997e-06 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950170+0000", 2024-09-16T04:08:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020803670000000001 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950297+0000", 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127062 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950926+0000", 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062826500000000003 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951904+0000", 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000978694 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963618+0000", 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011714096 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963770+0000", 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015180799999999999 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:33 3.9s0 3:93634e21:::smithi20431790-11:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.727910164999997, 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018249636999999999, 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 33 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948125+0000", 2024-09-16T04:08:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.159e-06 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948130+0000", 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5559999999999998e-06 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948145+0000", 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5057e-05 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948155+0000", 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7040000000000006e-06 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951232+0000", 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077069 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951336+0000", 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103558 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964171+0000", 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012834887999999999 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964283+0000", 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112611 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966373+0000", 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020900350000000001 2024-09-16T04:08:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:99 3.0s0 3:0daec8ce:::smithi20431790-33:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.660606934999997, 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008043718, 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 99 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0299999999999999e-07 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015431+0000", 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9940000000000002e-06 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015441+0000", 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-16T04:08:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015448+0000", 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018104+0000", 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026563300000000001 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018194+0000", 2024-09-16T04:08:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9544999999999997e-05 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021888+0000", 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036945709999999998 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.022023+0000", 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013508899999999999 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.023471+0000", 2024-09-16T04:08:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001447343 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:109 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~606208,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.645750403000001, 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069726889999999998, 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 109 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:08:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030285+0000", 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8330000000000001e-06 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030998+0000", 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071285399999999996 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031011+0000", 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2935000000000001e-05 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031017+0000", 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031073+0000", 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6746999999999997e-05 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031204+0000", 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013035600000000001 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032021+0000", 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081749100000000005 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033799+0000", 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001777666 2024-09-16T04:08:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037138+0000", 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00333943 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037256+0000", 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117754 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:111 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.644969428000003, 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085961969999999999, 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031065+0000", 2024-09-16T04:08:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0100000000000005e-07 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031067+0000", 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031075+0000", 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.498e-06 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031080+0000", 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3159999999999996e-06 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033632+0000", 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025523619999999999 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033720+0000", 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7457e-05 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037855+0000", 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041353259999999999 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037942+0000", 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7039999999999993e-05 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039661+0000", 2024-09-16T04:08:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001718327 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:118 3.0s0 3:04de99e5:::smithi20431790-40:head [append 0~671744,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.634048900000003, 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078732079999999996, 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 118 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:08:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041987+0000", 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042717+0000", 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073003100000000002 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042741+0000", 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4037e-05 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042755+0000", 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3828e-05 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042940+0000", 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018496100000000001 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.043139+0000", 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019973899999999999 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044207+0000", 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001067822 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045575+0000", 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013682729999999999 2024-09-16T04:08:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049772+0000", 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041967660000000002 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049858+0000", 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5833000000000003e-05 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:119 3.0s0 3:04de99e5:::smithi20431790-40:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.633246712000002, 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072748409999999998, 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 119 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042788+0000", 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.031e-06 2024-09-16T04:08:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042794+0000", 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5969999999999999e-06 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042805+0000", 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1375999999999999e-05 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042812+0000", 2024-09-16T04:08:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.613e-06 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044774+0000", 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019619059999999998 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044887+0000", 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011298600000000001 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045362+0000", 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047594299999999999 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045858+0000", 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000495193 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049963+0000", 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041055500000000003 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050062+0000", 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8646000000000004e-05 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:120 3.0s0 3:04de99e5:::smithi20431790-40:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.633211717000002, 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091318960000000005, 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 120 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042823+0000", 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0699999999999997e-07 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042825+0000", 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.441e-06 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042834+0000", 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4099999999999997e-06 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042840+0000", 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.728e-06 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045635+0000", 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027951059999999999 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045745+0000", 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109392 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050479+0000", 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047341659999999997 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050579+0000", 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9852999999999994e-05 2024-09-16T04:08:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.051954+0000", 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013752930000000001 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:136 3.0s0 3:0316444d:::smithi20431790-46:head [append 0~770048,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.605218436000001, 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006793075, 2024-09-16T04:08:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070817+0000", 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.911e-06 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071720+0000", 2024-09-16T04:08:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00090319599999999999 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071743+0000", 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3003e-05 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071755+0000", 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1157e-05 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071832+0000", 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7206999999999994e-05 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071946+0000", 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114251 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.072639+0000", 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069292699999999997 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074184+0000", 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015451639999999999 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077540+0000", 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556760000000001 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077608+0000", 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8583000000000004e-05 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:138 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.604213565000002, 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098477340000000003, 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-16T04:08:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071821+0000", 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0399999999999996e-07 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071824+0000", 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9639999999999999e-06 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071833+0000", 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7879999999999995e-06 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071839+0000", 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9959999999999999e-06 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074071+0000", 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022326329999999999 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074173+0000", 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101989 2024-09-16T04:08:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078912+0000", 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047384030000000004 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078998+0000", 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6192000000000004e-05 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081668+0000", 2024-09-16T04:08:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002670165 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:188 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~589824] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.68574504, 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016933011000000001, 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 188 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990292+0000", 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9330000000000001e-06 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991612+0000", 2024-09-16T04:08:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319888 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991650+0000", 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8581999999999998e-05 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991668+0000", 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8051999999999999e-05 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991865+0000", 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000196403 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991887+0000", 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2492000000000001e-05 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995547+0000", 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036596369999999999 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995693+0000", 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146136 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998906+0000", 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032132800000000002 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005918+0000", 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070119850000000001 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007080+0000", 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001161673 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007222+0000", 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014195000000000001 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:189 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~376832] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.679466562000002, 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012452869, 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 189 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996570+0000", 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.756e-06 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997415+0000", 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00084544299999999998 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997456+0000", 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0561e-05 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997484+0000", 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8129000000000001e-05 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000795+0000", 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033113959999999999 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000996+0000", 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020074599999999999 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018127729999999999 2024-09-16T04:08:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005921+0000", 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003112489 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.008866+0000", 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029447100000000001 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009020+0000", 2024-09-16T04:08:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015386600000000001 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:190 3.9s0 3:9410ed93:::smithi20431790-37:head [setxattr _header (56) in=7b] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.678504245999999, 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012174411, 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 190 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:08:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997531+0000", 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-06 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997540+0000", 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999999e-06 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997567+0000", 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7121e-05 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997598+0000", 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003915+0000", 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006316627 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.004057+0000", 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141512 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005216+0000", 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011591800000000001 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006552+0000", 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001335955 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009553+0000", 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030017009999999998 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009704+0000", 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015053199999999999 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:191 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.678386045, 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015318632, 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 191 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997649+0000", 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.533e-06 2024-09-16T04:08:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997657+0000", 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-06 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997681+0000", 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3952e-05 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997701+0000", 2024-09-16T04:08:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0378999999999999e-05 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007640+0000", 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099382580000000002 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007780+0000", 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140369 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010437+0000", 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002657459 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010564+0000", 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012679299999999999 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.012966+0000", 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024021590000000001 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:413 3.0s0 3:04de99e5:::smithi20431790-40:head [create,setxattr jmliR (209) in=5b,setxattr eRqQZNtlPRVjcgdjmbSmOsUSjSlU]tSoVjr`^oRN (489) in=40b,setxattr aR (209) in=2b,setxattr QP`igcZgYZ`X]j_`ObrUNcR_gQZW^mQs_T`XhhQp (10033) in=40b,setxattr V[thp]nUrl^Xata^al[oh[d`ddg`p[siljQWZ^\\X (350) in=40b,setxattr Pp[amim]nQkdfb][ca]Rhonh_mr`cpapUabYUfb\\ (9612) in=40b,setxattr jecnmafmfg__r^\\S_sU]bi]kYaplTcttSSX`\\prR (18524) in=40b,setxattr fVRh^qlag^rjpdaqVk`^r]eR`P[XUlr]]agZjWq[ (1998) in=40b,setxattr hgq\\iqsggNPTRPQok (209) in=17b,setxattr frZXQX\\isoq]gmjs`rk]PiQ\\fV[RTNPNYN]YV[mq (842) in=40b,setxattr `U`PSXddYml`lYXX[sSNnPfg`VgWbXsYnftUQ`it (558) in=40b,setxattr h\\bUdlZ]kknhkaaYeTcclaXatghTgbVrhNQblto_ (946) in=40b,setxattr XgcaedbaNamUmoa^d[dhg[arrjeikfUlToSjsbY` (877) in=40b,setxattr QXqRngrniZSrdNdQaffOsm_g_pYQoedrXoNqT[mn (561) in=40b,setxattr ][ifNPWgaZd[^RnfpRhWbfS\\^a]m[\\[ienetlUUZ (173) in=40b,setxattr mnhUacnNajpOrNecmPZT[OUj[XaWmU (209) in=30b,setxattr ZcXlR_O_^fXfTQrt`cZfOgVlmhepod\\^\\`socsW` (16348) in=40b,setxattr rZrXsckW]Y`iWQiRn (209) in=17b,setxattr peUYXiNb_UsOaXnhlX_s_[QTW_SoUaN]Wal`rkao (1997) in=40b,setxattr eNsVcjeRcj\\m]Q[VhYdSqNcmPhhR[UPR^ORSk_Vd (1823) in=40b] snapc c=[c,a,9] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.608058892999999, 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069071089999999998, 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 413 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067978+0000", 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0809999999999998e-06 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068117+0000", 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013882400000000001 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068146+0000", 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9218e-05 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068160+0000", 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068234+0000", 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3287000000000005e-05 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068326+0000", 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2238999999999996e-05 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.069117+0000", 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079102700000000003 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.070488+0000", 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013705430000000001 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.074811+0000", 2024-09-16T04:08:53.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043237340000000001 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.074882+0000", 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0681999999999999e-05 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:437 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.070909+0000", 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.605124258, 2024-09-16T04:08:53.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073092299999999999, 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 437 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070909+0000", 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070909+0000", 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070912+0000", 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.915e-06 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070927+0000", 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4788e-05 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070955+0000", 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8144999999999999e-05 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070968+0000", 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2792999999999999e-05 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071042+0000", 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3402e-05 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071050+0000", 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4039999999999995e-06 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.072981+0000", 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001930927 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073081+0000", 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100139 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.078219+0000", 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005137717 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:438 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.605032054, 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085326459999999996, 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5300000000000004e-07 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071007+0000", 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7249999999999997e-06 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071015+0000", 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071021+0000", 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4620000000000001e-06 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071104+0000", 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2933e-05 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071108+0000", 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.461e-06 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073470+0000", 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002361859 2024-09-16T04:08:53.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073554+0000", 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4116999999999994e-05 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.079534+0000", 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059806620000000003 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:439 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.605003266000001, 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095037699999999999, 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 439 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071031+0000", 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-07 2024-09-16T04:08:53.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071035+0000", 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.476e-06 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071042+0000", 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8569999999999997e-06 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071050+0000", 2024-09-16T04:08:53.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4410000000000004e-06 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071119+0000", 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9746999999999995e-05 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071122+0000", 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.869e-06 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073841+0000", 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027184179999999998 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073967+0000", 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012589400000000001 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.080534+0000", 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065675780000000001 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:658 3.0s0 3:0316444d:::smithi20431790-46:head [create,setxattr Z]ca\\SkkXhsYi]s_mecUZQfPbbjaqacZrSObr_`a (734) in=40b,setxattr i (1998) in=1b,setxattr OQosgYUVOPebZdfit`Xtcc]XX_pdNqdkSof_lrck (1822) in=40b,setxattr mrQaYTllqfj^q]UYaoR`drdgY]bVfYQ\\SgOe_gca (1789) in=40b,setxattr ZaeONfchPlXaOYt[dQNtaR[NNiaSangpfQNVhVY[ (1646) in=40b,setxattr epskr[spqr^j^XqcosqPQ (1998) in=21b,setxattr WarqdipUlkSQhTbQR[NhrYRrda[QmOgj^VqWWero (313) in=40b,setxattr f\\fnrpSa`gWXj`Yo`dQY]Vdr[Z^`gkVjb^enmUig (1645) in=40b,setxattr bjWaN_RafX`the (1998) in=14b,setxattr nmdNljVWb`aR_`Oeb[l_OntR_YgidWjRabRf[]Ye (10596) in=40b,setxattr [nhisfmkVd_n_YV\\efebsW_pQaiWle_]o]rhc[bO (14456) in=40b,setxattr []hmkY]V]hkrrd]gr\\c\\hPq_smnTfakPZRNg^bY[ (1649) in=40b,setxattr ZZ\\\\jZnU`jtY\\[k]hnm`r_OYQeWTg\\rnQdX^rbhg (807) in=40b,setxattr QT_d^gX[dNZPP\\VapoetR^[gpVcZQXfhp^`l_Vh[ (66) in=40b,setxattr ee[ (1998) in=3b,setxattr RY\\sp]UifT[Zt\\[VenNWarqiiNSXsdnktf^QhT[U (487) in=40b,setxattr hUnl\\fnak]U``QN^rs`a^kfaQ`NoTVNnPXYbdmre (13680) in=40b,setxattr gha[S`afeloOcnfbeOkUV]T]ZTYWaOeaS]bbVa\\Q (1226) in=40b,setxattr NaraXbinjWQraPh`Pp]qnPWgWfZf[WaUb]oOY]^r (1611) in=40b,setxattr tpfZiddi]a^RVWpgOZormUeqYosdY_UsSpiQQRgj (1225) in=40b] snapc 14=[14,13] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.78495324099999997, 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089480040000000007, 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:08:53.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 658 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891085+0000", 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6970000000000001e-06 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891315+0000", 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022967199999999999 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891341+0000", 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5673999999999998e-05 2024-09-16T04:08:53.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891351+0000", 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0013000000000001e-05 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891476+0000", 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012553900000000001 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891490+0000", 2024-09-16T04:08:53.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4047e-05 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.893817+0000", 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023270819999999998 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.893904+0000", 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6553999999999998e-05 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:08:53.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.894635+0000", 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073132899999999996 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.895889+0000", 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012542040000000001 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.899945+0000", 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040559890000000003 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:08:53.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.900029+0000", 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3203999999999998e-05 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:08:53.788 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:08:53.789 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:53.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:08:53.791 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:53.791 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:53.792 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:53.792 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:53.792 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:53.792 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:53.793 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:53.793 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:53.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:53.777+0000 7fd8526bd640 0 -- 172.21.15.32:0/4270356637 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7fd84c225cc0 msgr2=0x7fd84c2280b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:53.794 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:53.784+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:53.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:53.802 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:53.854 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-16T04:08:53.856 INFO:tasks.rados.rados.0.smithi204.stdout:258: done (2 left) 2024-09-16T04:08:53.856 INFO:tasks.rados.rados.0.smithi204.stdout:259: done (1 left) 2024-09-16T04:08:53.856 INFO:tasks.rados.rados.0.smithi204.stdout:260: done (0 left) 2024-09-16T04:08:53.856 INFO:tasks.rados.rados.0.smithi204.stdout:261: snap_create 2024-09-16T04:08:53.919 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:53.917+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:53.928 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:53.928 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:53.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:08:53.991 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:53.988+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:54.070 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:54.070 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:54.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:08:54.092 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:54.087+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:54.194 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:54.189+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:54.253 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:54.253 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:54.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:08:54.315 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:54.312+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:54.395 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:54.391+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:54.396 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:54.396 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:54.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:08:54.496 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:54.492+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:54.570 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:54.570 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:54.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:08:54.597 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:54.593+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:54.698 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:54.693+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:54.760 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:54.760 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:54.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:08:54.798 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:54.797+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:54.847 INFO:tasks.rados.rados.0.smithi204.stdout:261: done (0 left) 2024-09-16T04:08:54.847 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 30 current snap is 21 2024-09-16T04:08:54.847 INFO:tasks.rados.rados.0.smithi204.stdout:262: seq_num 114 ranges {0=753664,753664=688128,1441792=475136} 2024-09-16T04:08:54.859 INFO:tasks.rados.rados.0.smithi204.stdout:262: writing smithi20431790-30 from 0 to 753664 tid 1 2024-09-16T04:08:54.872 INFO:tasks.rados.rados.0.smithi204.stdout:262: writing smithi20431790-30 from 753664 to 1441792 tid 2 2024-09-16T04:08:54.882 INFO:tasks.rados.rados.0.smithi204.stdout:262: writing smithi20431790-30 from 1441792 to 1916928 tid 3 2024-09-16T04:08:54.882 INFO:tasks.rados.rados.0.smithi204.stdout:263: snap_create 2024-09-16T04:08:54.882 INFO:tasks.rados.rados.0.smithi204.stdout:262: finishing write tid 1 to smithi20431790-30 2024-09-16T04:08:54.882 INFO:tasks.rados.rados.0.smithi204.stdout:262: finishing write tid 2 to smithi20431790-30 2024-09-16T04:08:54.890 INFO:tasks.rados.rados.0.smithi204.stdout:262: finishing write tid 3 to smithi20431790-30 2024-09-16T04:08:54.891 INFO:tasks.rados.rados.0.smithi204.stdout:262: finishing write tid 4 to smithi20431790-30 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:262: finishing write tid 5 to smithi20431790-30 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:262: oid 30 updating version 0 to 167 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:262: oid 30 updating version 167 to 168 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:262: oid 30 version 168 is already newer than 166 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:262: oid 30 version 168 is already newer than 165 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 168 (ObjNum 114 snap 21 seq_num 114) dirty exists 2024-09-16T04:08:54.897 INFO:tasks.rados.rados.0.smithi204.stdout:262: left oid 30 (ObjNum 114 snap 21 seq_num 114) 2024-09-16T04:08:54.899 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:54.896+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:54.905 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:54.905 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:54.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:08:55.000 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:54.997+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:55.097 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.097 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.101 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:55.097+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:55.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:08:55.201 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:55.199+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:55.236 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.236 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:08:55.303 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:55.301+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:55.375 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.376 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:08:55.403 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:55.401+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:55.504 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:55.499+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:55.508 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.509 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:08:55.605 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:55.602+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.663 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:08:55.706 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:55.699+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:55.793 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.793 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:08:55.808 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:55.804+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:55.824 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:08:55.848 INFO:tasks.rados.rados.0.smithi204.stdout:262: done (1 left) 2024-09-16T04:08:55.849 INFO:tasks.rados.rados.0.smithi204.stdout:263: done (0 left) 2024-09-16T04:08:55.849 INFO:tasks.rados.rados.0.smithi204.stdout:264: read oid 32 snap -1 2024-09-16T04:08:55.849 INFO:tasks.rados.rados.0.smithi204.stdout:264: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:55.849 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 10 current snap is 22 2024-09-16T04:08:55.849 INFO:tasks.rados.rados.0.smithi204.stdout:265: seq_num 115 ranges {1949696=770048,2719744=704512,3424256=458752} 2024-09-16T04:08:55.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-16T04:08:55.893 INFO:tasks.rados.rados.0.smithi204.stdout:265: writing smithi20431790-10 from 1949696 to 2719744 tid 1 2024-09-16T04:08:55.903 INFO:tasks.rados.rados.0.smithi204.stdout:265: writing smithi20431790-10 from 2719744 to 3424256 tid 2 2024-09-16T04:08:55.907 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:55.903+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:55.909 INFO:tasks.rados.rados.0.smithi204.stdout:265: writing smithi20431790-10 from 3424256 to 3883008 tid 3 2024-09-16T04:08:55.909 INFO:tasks.rados.rados.0.smithi204.stdout:266: delete oid 19 current snap is 22 2024-09-16T04:08:55.909 INFO:tasks.rados.rados.0.smithi204.stdout:264: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:55.941 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:55.941 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:55.956 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: finishing write tid 1 to smithi20431790-10 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: finishing write tid 2 to smithi20431790-10 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: finishing write tid 3 to smithi20431790-10 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: finishing write tid 4 to smithi20431790-10 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: finishing write tid 5 to smithi20431790-10 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: oid 10 updating version 0 to 99 2024-09-16T04:08:55.967 INFO:tasks.rados.rados.0.smithi204.stdout:265: oid 10 version 99 is already newer than 98 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:265: oid 10 updating version 99 to 100 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:265: oid 10 version 100 is already newer than 97 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 10 v 100 (ObjNum 115 snap 22 seq_num 115) dirty exists 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:265: left oid 10 (ObjNum 115 snap 22 seq_num 115) 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:264: done (2 left) 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:265: done (1 left) 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:266: done (0 left) 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:267: read oid 19 snap -1 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:267: expect deleted 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:268: copy_from oid 48 from oid 9 current snap is 22 2024-09-16T04:08:55.968 INFO:tasks.rados.rados.0.smithi204.stdout:269: delete oid 43 current snap is 22 2024-09-16T04:08:55.973 INFO:tasks.rados.rados.0.smithi204.stdout:267: done (2 left) 2024-09-16T04:08:55.973 INFO:tasks.rados.rados.0.smithi204.stdout:269: done (1 left) 2024-09-16T04:08:55.974 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 3 current snap is 22 2024-09-16T04:08:55.974 INFO:tasks.rados.rados.0.smithi204.stdout:270: seq_num 118 ranges {622592=442368,1064960=753664,1818624=655360,2473984=147456} 2024-09-16T04:08:55.989 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:55.990 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:55.991 INFO:tasks.rados.rados.0.smithi204.stdout:270: writing smithi20431790-3 from 622592 to 1064960 tid 1 2024-09-16T04:08:56.005 INFO:tasks.rados.rados.0.smithi204.stdout:270: writing smithi20431790-3 from 1064960 to 1818624 tid 2 2024-09-16T04:08:56.008 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:56.003+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:56.016 INFO:tasks.rados.rados.0.smithi204.stdout:270: writing smithi20431790-3 from 1818624 to 2473984 tid 3 2024-09-16T04:08:56.018 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:56.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:270: writing smithi20431790-3 from 2473984 to 2621440 tid 4 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:271: rollback oid 2 current snap is 22 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 2 to 19 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:268: finishing copy_from racing read to smithi20431790-48 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:268: finishing copy_from to smithi20431790-48 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 48 v 39 (ObjNum 113 snap 19 seq_num 113) dirty exists 2024-09-16T04:08:56.019 INFO:tasks.rados.rados.0.smithi204.stdout:270: finishing write tid 1 to smithi20431790-3 2024-09-16T04:08:56.020 INFO:tasks.rados.rados.0.smithi204.stdout:270: finishing write tid 2 to smithi20431790-3 2024-09-16T04:08:56.020 INFO:tasks.rados.rados.0.smithi204.stdout:268: done (2 left) 2024-09-16T04:08:56.020 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 40 current snap is 22 2024-09-16T04:08:56.020 INFO:tasks.rados.rados.0.smithi204.stdout:272: seq_num 119 ranges {1966080=458752,2424832=507904,2932736=507904,3440640=458752,3899392=81920} 2024-09-16T04:08:56.042 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:56.042 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:56.050 INFO:tasks.rados.rados.0.smithi204.stdout:272: writing smithi20431790-40 from 1966080 to 2424832 tid 1 2024-09-16T04:08:56.056 INFO:tasks.rados.rados.0.smithi204.stdout:272: writing smithi20431790-40 from 2424832 to 2932736 tid 2 2024-09-16T04:08:56.061 INFO:tasks.rados.rados.0.smithi204.stdout:272: writing smithi20431790-40 from 2932736 to 3440640 tid 3 2024-09-16T04:08:56.065 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:56.065 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:56.066 INFO:tasks.rados.rados.0.smithi204.stdout:272: writing smithi20431790-40 from 3440640 to 3899392 tid 4 2024-09-16T04:08:56.067 INFO:tasks.rados.rados.0.smithi204.stdout:272: writing smithi20431790-40 from 3899392 to 3981312 tid 5 2024-09-16T04:08:56.067 INFO:tasks.rados.rados.0.smithi204.stdout:273: delete oid 31 current snap is 22 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:271: finishing rollback tid 0 to smithi20431790-2 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:270: finishing write tid 3 to smithi20431790-3 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:271: finishing rollback tid 1 to smithi20431790-2 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:271: finishing rollback tid 2 to smithi20431790-2 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 2 v 44 (ObjNum 101 snap 15 seq_num 101) dirty exists 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:270: finishing write tid 4 to smithi20431790-3 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:270: finishing write tid 5 to smithi20431790-3 2024-09-16T04:08:56.068 INFO:tasks.rados.rados.0.smithi204.stdout:270: finishing write tid 6 to smithi20431790-3 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:270: oid 3 updating version 0 to 53 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:270: oid 3 updating version 53 to 55 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:270: oid 3 version 55 is already newer than 54 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:270: oid 3 updating version 55 to 57 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:270: oid 3 version 57 is already newer than 56 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 3 v 57 (ObjNum 118 snap 22 seq_num 118) dirty exists 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:270: left oid 3 (ObjNum 118 snap 22 seq_num 118) 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 1 to smithi20431790-40 2024-09-16T04:08:56.069 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 2 to smithi20431790-40 2024-09-16T04:08:56.071 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 3 to smithi20431790-40 2024-09-16T04:08:56.074 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 4 to smithi20431790-40 2024-09-16T04:08:56.075 INFO:tasks.rados.rados.0.smithi204.stdout:270: done (3 left) 2024-09-16T04:08:56.075 INFO:tasks.rados.rados.0.smithi204.stdout:271: done (2 left) 2024-09-16T04:08:56.075 INFO:tasks.rados.rados.0.smithi204.stdout:273: done (1 left) 2024-09-16T04:08:56.075 INFO:tasks.rados.rados.0.smithi204.stdout:274: setattr oid 42 current snap is 22 2024-09-16T04:08:56.077 INFO:tasks.rados.rados.0.smithi204.stdout:275: rmattr oid 49 current snap is 22 2024-09-16T04:08:56.077 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 2 current snap is 22 2024-09-16T04:08:56.077 INFO:tasks.rados.rados.0.smithi204.stdout:276: seq_num 121 ranges {4341760=491520,4833280=802816,5636096=720896,6356992=32768} 2024-09-16T04:08:56.085 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:56.086 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:56.089 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:56.089 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.147886298000003, 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088452600000000006, 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7599999999999997e-07 2024-09-16T04:08:56.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937675+0000", 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000112378 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1192e-05 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937716+0000", 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9786e-05 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937875+0000", 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015905699999999999 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937897+0000", 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2442999999999998e-05 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946338+0000", 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084413119999999994 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946407+0000", 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8516000000000006e-05 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:56.094 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.146294740000002, 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073144209999999998, 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939155+0000", 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.823e-06 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939194+0000", 2024-09-16T04:08:56.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9060999999999998e-05 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939224+0000", 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0009e-05 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939288+0000", 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4290999999999998e-05 2024-09-16T04:08:56.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939471+0000", 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018293899999999999 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939493+0000", 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1849999999999999e-05 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946414+0000", 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069205860000000003 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946468+0000", 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3862e-05 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.099 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=0, reqid=client.4631.0:34, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.131515161000003, 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010827755999999999, 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953934+0000", 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3099999999999996e-07 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955299+0000", 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001365401 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955338+0000", 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8804000000000003e-05 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955361+0000", 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3472000000000002e-05 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000184064 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955568+0000", 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2425e-05 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964640+0000", 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090716189999999995 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964761+0000", 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012104000000000001 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.104 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=2, reqid=client.4631.0:17, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.129078667999998, 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093557269999999994, 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956371+0000", 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9069999999999999e-06 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956399+0000", 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7784999999999999e-05 2024-09-16T04:08:56.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956441+0000", 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1727999999999998e-05 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956464+0000", 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2991999999999999e-05 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956620+0000", 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015645500000000001 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956649+0000", 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8438000000000001e-05 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965629+0000", 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089807140000000008 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965725+0000", 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5707999999999999e-05 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 34/31 ECSubWrite(tid=2, reqid=client.4631.0:5, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.128859515999999, 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092008920000000004, 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.109 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956590+0000", 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5060000000000001e-06 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956611+0000", 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1123000000000001e-05 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956633+0000", 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1464999999999999e-05 2024-09-16T04:08:56.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956651+0000", 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8113000000000001e-05 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956835+0000", 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018435000000000001 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956855+0000", 2024-09-16T04:08:56.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9629000000000001e-05 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965720+0000", 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088648259999999993 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965789+0000", 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9880000000000002e-05 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.113 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=1, reqid=client.4631.0:35, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.126068965000002, 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006492589, 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:56.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959380+0000", 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.42e-06 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.115 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959416+0000", 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5373000000000002e-05 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959452+0000", 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6328999999999997e-05 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959471+0000", 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8991000000000002e-05 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959623+0000", 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015206900000000001 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959635+0000", 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1712000000000001e-05 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965813+0000", 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061778650000000003 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965872+0000", 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8829999999999997e-05 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 34/31 ECSubWrite(tid=8, reqid=client.4631.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.124022965999998, 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048114000000000004, 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.118 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961425+0000", 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961426+0000", 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5900000000000005e-07 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961448+0000", 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2376000000000001e-05 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961480+0000", 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1862000000000001e-05 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961504+0000", 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3921e-05 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961641+0000", 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013634000000000001 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961659+0000", 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8451e-05 2024-09-16T04:08:56.121 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966086+0000", 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044267330000000004 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966236+0000", 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000150758 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.122 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds5 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.099269878000001, 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0064133979999999998, 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.123 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986180+0000", 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.61e-06 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986500+0000", 2024-09-16T04:08:56.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00032045199999999999 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986536+0000", 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5522999999999999e-05 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986565+0000", 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9445999999999999e-05 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.125 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986758+0000", 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019237 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986779+0000", 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1359e-05 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992509+0000", 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0057302610000000004 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.126 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992592+0000", 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2377000000000001e-05 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 25.232666441999999, 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094335619999999995, 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.127 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.128 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3300000000000001e-07 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852840+0000", 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8068e-05 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852875+0000", 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4016000000000001e-05 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.129 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852916+0000", 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1301000000000003e-05 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853436+0000", 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052021800000000003 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853462+0000", 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5602e-05 2024-09-16T04:08:56.130 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862103+0000", 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086416559999999993 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862215+0000", 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011186799999999999 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.131 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 25.232148958, 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088015860000000001, 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.132 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853300+0000", 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853354+0000", 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3897999999999998e-05 2024-09-16T04:08:56.133 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853383+0000", 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9689e-05 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853406+0000", 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2289e-05 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.134 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853644+0000", 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023859799999999999 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853670+0000", 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5609000000000002e-05 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.861999+0000", 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083290640000000006 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.135 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862101+0000", 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000101846 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 54/31 ECSubWrite(tid=72, reqid=osd.5.0:72, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070520+0000", 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.014928001000001, 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006188051, 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.136 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070520+0000", 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070520+0000", 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.137 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070521+0000", 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.0599999999999999e-07 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070586+0000", 2024-09-16T04:08:56.138 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4691999999999997e-05 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070619+0000", 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3732000000000002e-05 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070645+0000", 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5579e-05 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.140 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070878+0000", 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000233556 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070904+0000", 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5812999999999998e-05 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.076594+0000", 2024-09-16T04:08:56.141 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0056900600000000003 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.076708+0000", 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000113713 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 54/31 ECSubWrite(tid=97, reqid=osd.13.0:97, at_version=54'27, trim_to=0'0, roll_forward_to=52'25))", 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.011371582999999, 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006242633, 2024-09-16T04:08:56.142 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.143 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074077+0000", 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8299999999999995e-07 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074158+0000", 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0173999999999995e-05 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074189+0000", 2024-09-16T04:08:56.144 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1086e-05 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074228+0000", 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9184999999999998e-05 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074411+0000", 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018316400000000001 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.145 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074437+0000", 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6023000000000001e-05 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080222+0000", 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005785241 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080319+0000", 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6877000000000001e-05 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.146 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 54/31 ECSubWrite(tid=36, reqid=osd.8.0:35, at_version=0'0, trim_to=0'0, roll_forward_to=54'23))", 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.084619+0000", 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.000828926000001, 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0052821229999999997, 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084619+0000", 2024-09-16T04:08:56.147 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084619+0000", 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084621+0000", 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9829999999999999e-06 2024-09-16T04:08:56.148 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084650+0000", 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8745999999999999e-05 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084680+0000", 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0049e-05 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.149 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084705+0000", 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5585999999999999e-05 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084917+0000", 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021142000000000001 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.084942+0000", 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4632000000000001e-05 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.150 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089802+0000", 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048603639999999998 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089901+0000", 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9343000000000001e-05 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds5 54/31 ECSubWrite(tid=100, reqid=osd.13.0:98, at_version=0'0, trim_to=0'0, roll_forward_to=54'9))", 2024-09-16T04:08:56.151 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.087662+0000", 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 18.997785835999998, 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.004865711, 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087662+0000", 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087662+0000", 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087664+0000", 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8199999999999999e-06 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087692+0000", 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8056e-05 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087724+0000", 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1686000000000001e-05 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087747+0000", 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3439e-05 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087955+0000", 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020818400000000001 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087995+0000", 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.0089000000000002e-05 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.092444+0000", 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044484950000000002 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.092528+0000", 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3942000000000004e-05 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.155 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 54/31 ECSubWrite(tid=75, reqid=osd.5.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=54'21))", 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 18.996016924999999, 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062013679999999996, 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.156 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089433+0000", 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0470000000000001e-06 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089464+0000", 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0451999999999999e-05 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089503+0000", 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9721999999999997e-05 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089528+0000", 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4375999999999998e-05 2024-09-16T04:08:56.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089700+0000", 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017223499999999999 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089724+0000", 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4485999999999999e-05 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.095544+0000", 2024-09-16T04:08:56.159 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058195529999999999 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.095632+0000", 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8497000000000003e-05 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=88, reqid=client.4631.0:469, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:41.870395+0000", 2024-09-16T04:08:56.160 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.215053354, 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0051398069999999997, 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870395+0000", 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870395+0000", 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870397+0000", 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9369999999999998e-06 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870418+0000", 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1189999999999999e-05 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870457+0000", 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8924999999999997e-05 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870480+0000", 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2878999999999999e-05 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870621+0000", 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014113299999999999 2024-09-16T04:08:56.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.870639+0000", 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8206000000000002e-05 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.875443+0000", 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048040640000000003 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:41.875534+0000", 2024-09-16T04:08:56.164 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.1472999999999996e-05 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 60/31 ECSubWrite(tid=39, reqid=osd.8.0:39, at_version=60'27, trim_to=0'0, roll_forward_to=57'25))", 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 13.203291038, 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069862259999999999, 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882158+0000", 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0130000000000001e-06 2024-09-16T04:08:56.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882227+0000", 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8670999999999994e-05 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882263+0000", 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6729e-05 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882287+0000", 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3963000000000001e-05 2024-09-16T04:08:56.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882459+0000", 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017120899999999999 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882486+0000", 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7611999999999999e-05 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889027+0000", 2024-09-16T04:08:56.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065408530000000001 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889143+0000", 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011617599999999999 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 63/31 ECSubWrite(tid=110, reqid=client.4631.0:509, at_version=63'54, trim_to=0'0, roll_forward_to=63'53))", 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 9.9086196290000004, 2024-09-16T04:08:56.169 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073621579999999997, 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.170 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176830+0000", 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0760000000000001e-06 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179214+0000", 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0023831529999999998 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179253+0000", 2024-09-16T04:08:56.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9088999999999998e-05 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179284+0000", 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179490+0000", 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020643500000000001 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179520+0000", 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9822999999999999e-05 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184081+0000", 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0045612500000000002 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184191+0000", 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010942699999999999 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.173 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 64/31 ECSubWrite(tid=46, reqid=osd.15.0:46, at_version=64'31, trim_to=0'0, roll_forward_to=63'29))", 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.913145+0000", 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 9.1723026510000008, 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0055190760000000004, 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913145+0000", 2024-09-16T04:08:56.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913145+0000", 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913146+0000", 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1200000000000001e-06 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.175 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913199+0000", 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2404999999999997e-05 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913242+0000", 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2849000000000003e-05 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913265+0000", 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3710000000000002e-05 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913471+0000", 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000205637 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913498+0000", 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7250000000000002e-05 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918562+0000", 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050638239999999998 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918664+0000", 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010228100000000001 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 64/31 ECSubWrite(tid=114, reqid=osd.5.0:113, at_version=0'0, trim_to=0'0, roll_forward_to=64'58))", 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 9.1558016020000004, 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098458810000000008, 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.178 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929652+0000", 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929681+0000", 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9323e-05 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929713+0000", 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1639e-05 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929735+0000", 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2246e-05 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929957+0000", 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022144100000000001 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929982+0000", 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5636e-05 2024-09-16T04:08:56.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.939392+0000", 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094095789999999995 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.939492+0000", 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000100444 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.182 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.183 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:56.184 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:56.185 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:56.185 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:56.186 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:56.186 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:08:56.187 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:56.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:56.188 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:56.188 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:56.190 INFO:tasks.rados.rados.0.smithi204.stdout:276: writing smithi20431790-2 from 4341760 to 4833280 tid 1 2024-09-16T04:08:56.190 INFO:tasks.rados.rados.0.smithi204.stdout:276: writing smithi20431790-2 from 4833280 to 5636096 tid 2 2024-09-16T04:08:56.190 INFO:tasks.rados.rados.0.smithi204.stdout:276: writing smithi20431790-2 from 5636096 to 6356992 tid 3 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:276: writing smithi20431790-2 from 6356992 to 6389760 tid 4 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:277: read oid 25 snap -1 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:277: expect (ObjNum 24 snap 0 seq_num 24) 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:278: delete oid 7 current snap is 22 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 5 to smithi20431790-40 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 6 to smithi20431790-40 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: finishing write tid 7 to smithi20431790-40 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: oid 40 updating version 0 to 37 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: oid 40 updating version 37 to 42 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: oid 40 version 42 is already newer than 39 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: oid 40 version 42 is already newer than 38 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: oid 40 version 42 is already newer than 41 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:272: oid 40 version 42 is already newer than 40 2024-09-16T04:08:56.191 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 40 v 42 (ObjNum 119 snap 22 seq_num 119) dirty exists 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:272: left oid 40 (ObjNum 119 snap 22 seq_num 119) 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 42 v 99 (ObjNum 33 snap 0 seq_num 1077374224) dirty exists 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 102 (ObjNum 89 snap 11 seq_num 89) dirty exists 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:276: finishing write tid 1 to smithi20431790-2 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:276: finishing write tid 2 to smithi20431790-2 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:276: finishing write tid 3 to smithi20431790-2 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:276: finishing write tid 4 to smithi20431790-2 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:276: finishing write tid 5 to smithi20431790-2 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:272: done (5 left) 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:274: done (4 left) 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:275: done (3 left) 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:278: done (2 left) 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:279: setattr oid 42 current snap is 22 2024-09-16T04:08:56.192 INFO:tasks.rados.rados.0.smithi204.stdout:276: finishing write tid 6 to smithi20431790-2 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: oid 2 updating version 0 to 47 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: oid 2 updating version 47 to 48 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: oid 2 updating version 48 to 49 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: oid 2 version 49 is already newer than 45 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: oid 2 version 49 is already newer than 46 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 2 v 49 (ObjNum 121 snap 22 seq_num 121) dirty exists 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: left oid 2 (ObjNum 121 snap 22 seq_num 121) 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:277: expect (ObjNum 24 snap 0 seq_num 24) 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:276: done (2 left) 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:277: done (1 left) 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:280: read oid 7 snap -1 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:280: expect deleted 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:281: read oid 45 snap -1 2024-09-16T04:08:56.193 INFO:tasks.rados.rados.0.smithi204.stdout:281: expect (ObjNum 108 snap 17 seq_num 108) 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:282: rollback oid 28 current snap is 22 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 28 to 18 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:283: read oid 37 snap 19 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:283: expect deleted 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:284: copy_from oid 40 from oid 27 current snap is 22 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:285: read oid 6 snap -1 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:285: expect (ObjNum 110 snap 17 seq_num 110) 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 11 current snap is 22 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:286: seq_num 123 ranges {0=524288,524288=573440,1097728=688128,1785856=294912} 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:286: writing smithi20431790-11 from 0 to 524288 tid 1 2024-09-16T04:08:56.194 INFO:tasks.rados.rados.0.smithi204.stdout:286: writing smithi20431790-11 from 524288 to 1097728 tid 2 2024-09-16T04:08:56.194 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:56.179+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:56.195 INFO:tasks.rados.rados.0.smithi204.stdout:286: writing smithi20431790-11 from 1097728 to 1785856 tid 3 2024-09-16T04:08:56.195 INFO:tasks.rados.rados.0.smithi204.stdout:286: writing smithi20431790-11 from 1785856 to 2080768 tid 4 2024-09-16T04:08:56.195 INFO:tasks.rados.rados.0.smithi204.stdout:287: read oid 46 snap -1 2024-09-16T04:08:56.196 INFO:tasks.rados.rados.0.smithi204.stdout:287: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-16T04:08:56.196 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 23 current snap is 22 2024-09-16T04:08:56.196 INFO:tasks.rados.rados.0.smithi204.stdout:288: seq_num 124 ranges {0=540672,540672=720896,1261568=786432,2048000=49152} 2024-09-16T04:08:56.196 INFO:tasks.rados.rados.0.smithi204.stdout:288: writing smithi20431790-23 from 0 to 540672 tid 1 2024-09-16T04:08:56.199 INFO:tasks.rados.rados.0.smithi204.stdout:288: writing smithi20431790-23 from 540672 to 1261568 tid 2 2024-09-16T04:08:56.199 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:56.205 INFO:tasks.rados.rados.0.smithi204.stdout:288: writing smithi20431790-23 from 1261568 to 2048000 tid 3 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:288: writing smithi20431790-23 from 2048000 to 2097152 tid 4 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:289: read oid 20 snap -1 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:289: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:290: delete oid 47 current snap is 22 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:282: finishing rollback tid 0 to smithi20431790-28 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:284: finishing copy_from racing read to smithi20431790-40 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:282: finishing rollback tid 1 to smithi20431790-28 2024-09-16T04:08:56.206 INFO:tasks.rados.rados.0.smithi204.stdout:282: finishing rollback tid 2 to smithi20431790-28 2024-09-16T04:08:56.207 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 28 v 87 (ObjNum 111 snap 17 seq_num 111) dirty exists 2024-09-16T04:08:56.207 INFO:tasks.rados.rados.0.smithi204.stdout:284: finishing copy_from to smithi20431790-40 2024-09-16T04:08:56.207 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 40 v 10 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-16T04:08:56.207 INFO:tasks.rados.rados.0.smithi204.stdout:287: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:286: finishing write tid 1 to smithi20431790-11 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:280: done (11 left) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:282: done (10 left) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:283: done (9 left) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:284: done (8 left) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:287: done (7 left) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:290: done (6 left) 2024-09-16T04:08:56.212 INFO:tasks.rados.rados.0.smithi204.stdout:291: snap_remove snap 17 2024-09-16T04:08:56.223 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:56.224 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:56.243 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:56.243 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:56.260 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:56.260 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:56.281 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:56.281 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:56.285 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:56.280+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:56.302 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:56.302 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:56.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:56.301+0000 7f71cf59e640 0 -- 172.21.15.32:0/76836225 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7f71d0226820 msgr2=0x7f71d0228c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:56.322 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:56.322 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:56.322 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:56.322 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:56.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:08:56.386 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:56.380+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:56.459 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:56.460 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:56.460 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:56.460 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:56.460 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:56.473 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:08:56.518 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:56.514+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:56.530 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:56.530 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:08:56.587 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:08:56.584+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:08:56.594 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:56.594 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:56.594 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s5 34/31 ECSubWrite(tid=9, reqid=client.4631.0:62, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.977941+0000", 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.613414800000001, 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090075710000000007, 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.595 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977941+0000", 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977941+0000", 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977942+0000", 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.437e-06 2024-09-16T04:08:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977981+0000", 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8583e-05 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978003+0000", 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1725999999999998e-05 2024-09-16T04:08:56.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978020+0000", 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7759000000000001e-05 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979397+0000", 2024-09-16T04:08:56.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0013765870000000001 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979419+0000", 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2385e-05 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986850+0000", 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.007430776 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986948+0000", 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.8318000000000003e-05 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:76 3.1s0 3:8cd578d6:::smithi20431790-26:head [append 0~425984,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.600633019999997, 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016989746999999999, 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 76 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.601 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990725+0000", 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7659999999999999e-06 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991908+0000", 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011824369999999999 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991959+0000", 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1104999999999999e-05 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991974+0000", 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.507e-05 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992175+0000", 2024-09-16T04:08:56.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000200748 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992429+0000", 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025421900000000003 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.994438+0000", 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0020088559999999998 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.000632+0000", 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061938200000000001 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007596+0000", 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069640379999999997 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007712+0000", 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000116688 2024-09-16T04:08:56.605 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:77 3.1s0 3:8cd578d6:::smithi20431790-26:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.599340673, 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016129303000000001, 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:56.606 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 77 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:08:56.607 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992016+0000", 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.142e-06 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992029+0000", 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2622e-05 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992042+0000", 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3453e-05 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992050+0000", 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0830000000000004e-06 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996215+0000", 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0041647710000000003 2024-09-16T04:08:56.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996322+0000", 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000106525 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996924+0000", 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00060262499999999997 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.001154+0000", 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0042302959999999997 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007954+0000", 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006799462 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008144+0000", 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019032399999999999 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.611 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:78 3.1s0 3:8cd578d6:::smithi20431790-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 39.599207988000003, 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019834738000000001, 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:56.612 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 78 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6300000000000004e-07 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992154+0000", 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5350000000000004e-06 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992164+0000", 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0467e-05 2024-09-16T04:08:56.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992176+0000", 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1438e-05 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.997489+0000", 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053126850000000002 2024-09-16T04:08:56.615 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.997713+0000", 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000224797 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008726+0000", 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011012533999999999 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:56.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008813+0000", 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6673000000000002e-05 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.011982+0000", 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031697460000000002 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.617 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 48/31 ECSubWrite(tid=144, reqid=osd.10.0:144, at_version=48'64, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852572+0000", 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 25.738783691999998, 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0081378679999999995, 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852572+0000", 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.618 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852572+0000", 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852573+0000", 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.5300000000000004e-07 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852652+0000", 2024-09-16T04:08:56.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9673999999999996e-05 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852690+0000", 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7412e-05 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852714+0000", 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3995999999999999e-05 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853013+0000", 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00029908799999999998 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853041+0000", 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7846000000000001e-05 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860590+0000", 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0075489270000000004 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.621 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860710+0000", 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120272 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs6 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.853100+0000", 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 25.738255676000001, 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078536160000000008, 2024-09-16T04:08:56.622 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853100+0000", 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853100+0000", 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.623 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853101+0000", 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6000000000000002e-07 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853152+0000", 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1388999999999999e-05 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853175+0000", 2024-09-16T04:08:56.624 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2379e-05 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853195+0000", 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0622999999999999e-05 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853999+0000", 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00080373900000000004 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.625 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.854022+0000", 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3030000000000001e-05 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860876+0000", 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068543689999999999 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.860954+0000", 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.7226999999999998e-05 2024-09-16T04:08:56.626 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.855607+0000", 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 25.735748693000001, 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084318569999999992, 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.627 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855607+0000", 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855607+0000", 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.628 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855609+0000", 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2029999999999999e-06 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855664+0000", 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4712000000000001e-05 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855698+0000", 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4499000000000003e-05 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.629 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855721+0000", 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2265000000000001e-05 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855878+0000", 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015689799999999999 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.855903+0000", 2024-09-16T04:08:56.630 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5585e-05 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.863941+0000", 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0080380320000000005 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.864039+0000", 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7663000000000003e-05 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.631 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070990+0000", 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.520365411, 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011792231, 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.632 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070990+0000", 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070990+0000", 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.633 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070992+0000", 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6500000000000001e-06 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071044+0000", 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2098999999999997e-05 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071074+0000", 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0232000000000001e-05 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.634 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071096+0000", 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1702999999999999e-05 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071318+0000", 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022174599999999999 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.635 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071343+0000", 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5741999999999998e-05 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.082689+0000", 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011345668999999999 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.082782+0000", 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3389999999999999e-05 2024-09-16T04:08:56.636 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.0s6 54/31 ECSubWrite(tid=71, reqid=osd.12.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=54'29))", 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.072544+0000", 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.518811555999999, 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010290921999999999, 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.637 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072544+0000", 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072544+0000", 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.638 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072545+0000", 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9300000000000006e-07 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072567+0000", 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1523e-05 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072591+0000", 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4301999999999999e-05 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.639 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072612+0000", 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1472999999999999e-05 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.073156+0000", 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00054402900000000002 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.073183+0000", 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6519000000000001e-05 2024-09-16T04:08:56.640 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.082735+0000", 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0095519760000000002 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.082835+0000", 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000100107 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.641 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s5 54/31 ECSubWrite(tid=186, reqid=osd.10.0:186, at_version=54'62, trim_to=0'0, roll_forward_to=53'60))", 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.517279975000001, 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092290429999999993, 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:56.642 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074078+0000", 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1739999999999999e-06 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.643 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074128+0000", 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.0411000000000002e-05 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074161+0000", 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2489e-05 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074211+0000", 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.0606000000000003e-05 2024-09-16T04:08:56.644 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074763+0000", 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00055161200000000004 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074796+0000", 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2595000000000002e-05 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.645 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.083205+0000", 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084090420000000003 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.083305+0000", 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000100114 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds6 54/31 ECSubWrite(tid=98, reqid=osd.13.0:98, at_version=54'9, trim_to=0'0, roll_forward_to=53'7))", 2024-09-16T04:08:56.646 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.075863+0000", 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.515492711, 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010007811, 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075863+0000", 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.647 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075863+0000", 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075865+0000", 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1900000000000002e-06 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075928+0000", 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.3374999999999995e-05 2024-09-16T04:08:56.648 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075957+0000", 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9002000000000001e-05 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.075979+0000", 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1648999999999999e-05 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.076133+0000", 2024-09-16T04:08:56.649 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000154165 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.076157+0000", 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3986e-05 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.085790+0000", 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0096322960000000003 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.650 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.085871+0000", 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1148000000000003e-05 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs6 54/31 ECSubWrite(tid=72, reqid=osd.5.0:72, at_version=54'21, trim_to=0'0, roll_forward_to=53'19))", 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.077543+0000", 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.513812967, 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010022656, 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.651 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077543+0000", 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077543+0000", 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.652 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077545+0000", 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4200000000000001e-06 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077601+0000", 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5695000000000001e-05 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077643+0000", 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2527999999999997e-05 2024-09-16T04:08:56.653 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077666+0000", 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3076000000000001e-05 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.078049+0000", 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00038271099999999999 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.654 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.078104+0000", 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4922e-05 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087474+0000", 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093702070000000002 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.087565+0000", 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.1096999999999999e-05 2024-09-16T04:08:56.655 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.5s1 54/31 ECSubWrite(tid=73, reqid=osd.5.0:73, at_version=54'16, trim_to=0'0, roll_forward_to=52'14))", 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.077746+0000", 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 19.513609274, 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0081967110000000006, 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.656 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077746+0000", 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077746+0000", 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077748+0000", 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1629999999999999e-06 2024-09-16T04:08:56.657 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077817+0000", 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9225000000000002e-05 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077844+0000", 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7651999999999999e-05 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.658 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077862+0000", 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7833e-05 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.077998+0000", 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000136212 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.078024+0000", 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6069999999999999e-05 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.659 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.085876+0000", 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.007851139 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.085943+0000", 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.7416999999999995e-05 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.660 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(osd.10.22:7 3.1s0 3:8c94f6f5:::smithi20431790-36:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.864847+0000", 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 13.726508726, 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015069387, 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864847+0000", 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.661 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864847+0000", 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864851+0000", 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.0439999999999997e-06 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864867+0000", 2024-09-16T04:08:56.662 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6348999999999999e-05 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864909+0000", 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1579000000000003e-05 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864934+0000", 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4763e-05 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.663 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.865127+0000", 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019343400000000001 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "op must wait for map", 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.865149+0000", 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2269e-05 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.871299+0000", 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061497219999999998 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.664 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.871534+0000", 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023460899999999999 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879916+0000", 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083826179999999997 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.665 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 60/31 ECSubWrite(tid=212, reqid=osd.10.0:212, at_version=60'106, trim_to=0'0, roll_forward_to=57'102))", 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 13.712330036999999, 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011330115999999999, 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.666 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6000000000000002e-07 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879100+0000", 2024-09-16T04:08:56.667 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3211000000000001e-05 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879123+0000", 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3422999999999999e-05 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879140+0000", 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7033000000000001e-05 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.668 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.880405+0000", 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0012647100000000001 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.880431+0000", 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6529e-05 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.669 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.890246+0000", 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098149099999999996 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.890356+0000", 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010944 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.670 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/31 ECSubWrite(tid=213, reqid=osd.10.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=60'66))", 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.879359+0000", 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 13.711996472999999, 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0091393020000000002, 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879359+0000", 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.671 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879359+0000", 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879360+0000", 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.19e-06 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879381+0000", 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0642e-05 2024-09-16T04:08:56.672 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879467+0000", 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6310999999999994e-05 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879487+0000", 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0152999999999998e-05 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.880477+0000", 2024-09-16T04:08:56.673 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00098988500000000003 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.880503+0000", 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5689000000000001e-05 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888401+0000", 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078982740000000003 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888498+0000", 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7157999999999994e-05 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs6 63/31 ECSubWrite(tid=110, reqid=client.4631.0:509, at_version=63'54, trim_to=0'0, roll_forward_to=63'53))", 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.177002+0000", 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.414353262000001, 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0077638450000000001, 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.675 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.177002+0000", 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.177002+0000", 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.177005+0000", 2024-09-16T04:08:56.676 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2330000000000001e-06 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179835+0000", 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002830235 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179877+0000", 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.2222000000000003e-05 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.677 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179903+0000", 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6043000000000001e-05 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.180113+0000", 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021039100000000001 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.180145+0000", 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1238999999999997e-05 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.678 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184662+0000", 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0045169579999999997 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184766+0000", 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000104524 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs6 64/31 ECSubWrite(tid=113, reqid=osd.5.0:113, at_version=64'58, trim_to=0'0, roll_forward_to=63'54))", 2024-09-16T04:08:56.679 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.901950+0000", 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 9.6894053899999992, 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083249139999999992, 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.901950+0000", 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.680 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.901950+0000", 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.901952+0000", 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8360000000000001e-06 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902006+0000", 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4351999999999997e-05 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.681 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902036+0000", 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9549000000000001e-05 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902062+0000", 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5746999999999999e-05 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902334+0000", 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00027210599999999999 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.682 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902360+0000", 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6186e-05 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.910158+0000", 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0077981810000000004 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.910275+0000", 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000116957 2024-09-16T04:08:56.683 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds6 64/31 ECSubWrite(tid=137, reqid=osd.13.0:137, at_version=64'17, trim_to=0'0, roll_forward_to=63'15))", 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.905291+0000", 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 9.6860648059999992, 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087967830000000007, 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.684 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905291+0000", 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905291+0000", 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905292+0000", 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.54e-07 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.685 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905356+0000", 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4117999999999998e-05 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905383+0000", 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7209999999999999e-05 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905405+0000", 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1954999999999999e-05 2024-09-16T04:08:56.686 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905592+0000", 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018761900000000001 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.905621+0000", 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8513e-05 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914006+0000", 2024-09-16T04:08:56.687 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083846159999999993 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914088+0000", 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1997999999999997e-05 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s5 64/31 ECSubWrite(tid=46, reqid=osd.15.0:46, at_version=64'31, trim_to=0'0, roll_forward_to=63'29))", 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.913783+0000", 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 9.6775730089999996, 2024-09-16T04:08:56.688 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093581749999999998, 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913783+0000", 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913783+0000", 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.689 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913783+0000", 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1399999999999996e-07 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913831+0000", 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.7997999999999997e-05 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913862+0000", 2024-09-16T04:08:56.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0510000000000001e-05 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913883+0000", 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0891999999999999e-05 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914254+0000", 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037120399999999998 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914279+0000", 2024-09-16T04:08:56.691 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4796000000000001e-05 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.923051+0000", 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087726030000000003 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.923141+0000", 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.9457999999999996e-05 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.692 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.693 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.693 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:56.694 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:08:56.695 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:56.691+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:56.795 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:56.793+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:56.857 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-16T04:08:56.859 INFO:tasks.rados.rados.0.smithi204.stdout:291: done (6 left) 2024-09-16T04:08:56.859 INFO:tasks.rados.rados.0.smithi204.stdout:292: rmattr oid 39 current snap is 22 2024-09-16T04:08:56.859 INFO:tasks.rados.rados.0.smithi204.stdout:292: done (6 left) 2024-09-16T04:08:56.859 INFO:tasks.rados.rados.0.smithi204.stdout:293: rollback oid 17 current snap is 22 2024-09-16T04:08:56.859 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 17 to 21 2024-09-16T04:08:56.859 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 42 v 100 (ObjNum 33 snap 0 seq_num 1077374224) dirty exists 2024-09-16T04:08:56.860 INFO:tasks.rados.rados.0.smithi204.stdout:286: finishing write tid 2 to smithi20431790-11 2024-09-16T04:08:56.860 INFO:tasks.rados.rados.0.smithi204.stdout:286: finishing write tid 3 to smithi20431790-11 2024-09-16T04:08:56.860 INFO:tasks.rados.rados.0.smithi204.stdout:279: done (6 left) 2024-09-16T04:08:56.860 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 49 current snap is 22 2024-09-16T04:08:56.860 INFO:tasks.rados.rados.0.smithi204.stdout:294: seq_num 126 ranges {3653632=573440,4227072=622592,4849664=622592,5472256=311296} 2024-09-16T04:08:56.868 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs5 74/31 ECSubWrite(tid=184, reqid=osd.13.0:183, at_version=0'0, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:56.866342+0000", 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 0.0022634669999999999, 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0023177190000000002, 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.869 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866342+0000", 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866342+0000", 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866344+0000", 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5099999999999999e-06 2024-09-16T04:08:56.870 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866367+0000", 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3203000000000001e-05 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866388+0000", 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0659e-05 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866402+0000", 2024-09-16T04:08:56.871 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4544e-05 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866484+0000", 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1630000000000003e-05 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.866494+0000", 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5969999999999998e-06 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.872 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:56.873 INFO:teuthology.orchestra.run.smithi196.stdout: ], 2024-09-16T04:08:56.873 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 1 2024-09-16T04:08:56.873 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:56.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:08:56.874 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:08:56.875 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2024-09-16T04:08:56.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:08:56.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:08:56.895 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:56.891+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:56.905 INFO:tasks.rados.rados.0.smithi204.stdout:294: writing smithi20431790-49 from 3653632 to 4227072 tid 1 2024-09-16T04:08:56.912 INFO:tasks.rados.rados.0.smithi204.stdout:294: writing smithi20431790-49 from 4227072 to 4849664 tid 2 2024-09-16T04:08:56.919 INFO:tasks.rados.rados.0.smithi204.stdout:294: writing smithi20431790-49 from 4849664 to 5472256 tid 3 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:294: writing smithi20431790-49 from 5472256 to 5783552 tid 4 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:295: copy_from oid 43 from oid 35 current snap is 22 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:286: finishing write tid 4 to smithi20431790-11 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:286: finishing write tid 5 to smithi20431790-11 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:286: finishing write tid 6 to smithi20431790-11 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:286: oid 11 updating version 0 to 29 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:286: oid 11 updating version 29 to 31 2024-09-16T04:08:56.922 INFO:tasks.rados.rados.0.smithi204.stdout:286: oid 11 version 31 is already newer than 28 2024-09-16T04:08:56.923 INFO:tasks.rados.rados.0.smithi204.stdout:286: oid 11 version 31 is already newer than 27 2024-09-16T04:08:56.923 INFO:tasks.rados.rados.0.smithi204.stdout:286: oid 11 version 31 is already newer than 30 2024-09-16T04:08:56.923 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 11 v 31 (ObjNum 123 snap 22 seq_num 123) dirty exists 2024-09-16T04:08:56.923 INFO:tasks.rados.rados.0.smithi204.stdout:286: left oid 11 (ObjNum 123 snap 22 seq_num 123) 2024-09-16T04:08:56.923 INFO:tasks.rados.rados.0.smithi204.stdout:285: expect (ObjNum 110 snap 17 seq_num 110) 2024-09-16T04:08:56.997 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:56.993+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:57.011 INFO:tasks.rados.rados.0.smithi204.stdout:288: finishing write tid 1 to smithi20431790-23 2024-09-16T04:08:57.011 INFO:tasks.rados.rados.0.smithi204.stdout:285: done (7 left) 2024-09-16T04:08:57.011 INFO:tasks.rados.rados.0.smithi204.stdout:286: done (6 left) 2024-09-16T04:08:57.011 INFO:tasks.rados.rados.0.smithi204.stdout:296: copy_from oid 34 from oid 22 current snap is 22 2024-09-16T04:08:57.011 INFO:tasks.rados.rados.0.smithi204.stdout:281: expect (ObjNum 108 snap 17 seq_num 108) 2024-09-16T04:08:57.012 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:57.012 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:57.012 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:57.012 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:57.012 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:57.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:08:57.098 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:57.093+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:57.150 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:57.150 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:57.150 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:57.150 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:2 3.4s0 3:23761325:::smithi20431790-1:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.214040732999997, 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.025102767000000002, 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.151 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 2 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932877+0000", 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.152 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932878+0000", 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.477e-06 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932887+0000", 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.0529999999999996e-06 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.153 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932905+0000", 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7428e-05 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932920+0000", 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5568000000000001e-05 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939855+0000", 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069352210000000001 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.154 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.155 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.155 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.940080+0000", 2024-09-16T04:08:57.155 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022506800000000001 2024-09-16T04:08:57.155 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.155 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.155 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011671030000000001 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949403+0000", 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0081551360000000003 2024-09-16T04:08:57.156 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957764+0000", 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083610560000000004 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.157 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957979+0000", 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021565700000000001 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:3 3.4s0 3:23761325:::smithi20431790-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.213978074000003, 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.046611916000000003, 2024-09-16T04:08:57.158 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 3 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:57.159 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932940+0000", 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1799999999999999e-06 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.160 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932969+0000", 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8867e-05 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932988+0000", 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9173000000000001e-05 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933004+0000", 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5821999999999999e-05 2024-09-16T04:08:57.161 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941757+0000", 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087529989999999992 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941968+0000", 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021104500000000001 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.162 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958099+0000", 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016130480999999999 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958362+0000", 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026272900000000001 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979551+0000", 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021189619999999999 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.163 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:14 3.bs0 3:ddc630b6:::smithi20431790-5:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.212962726999997, 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.029025773000000001, 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.164 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 14 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933955+0000", 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.165 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933956+0000", 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.455e-06 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933963+0000", 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1450000000000002e-06 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933980+0000", 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6909999999999999e-05 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.166 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933994+0000", 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4236999999999999e-05 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.944227+0000", 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010232893 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.167 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.947374+0000", 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031466839999999999 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.952631+0000", 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005256635 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956032+0000", 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0034013939999999999 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.168 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.962586+0000", 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006554458 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.962980+0000", 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00039396199999999998 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.169 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:15 3.bs0 3:ddc630b6:::smithi20431790-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.212901940999998, 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044909575, 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 15 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.170 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934017+0000", 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.302e-06 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.171 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934023+0000", 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2140000000000001e-06 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934039+0000", 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5690999999999999e-05 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934052+0000", 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3728e-05 2024-09-16T04:08:57.172 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955822+0000", 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021769189000000001 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956014+0000", 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019218999999999999 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.173 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963151+0000", 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00713688 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963673+0000", 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052261899999999999 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978925+0000", 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015251762 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.174 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:24 3.4s0 3:20db2d5a:::smithi20431790-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.205677098000002, 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039181856000000001, 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.175 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 24 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.176 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941242+0000", 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4670000000000001e-06 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2519999999999996e-06 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.177 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941266+0000", 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8502999999999999e-05 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941281+0000", 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4642e-05 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949167+0000", 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078853970000000006 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.178 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949385+0000", 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000218929 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961609+0000", 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012224016000000001 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961801+0000", 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019127200000000001 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.179 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980422+0000", 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018621378000000001 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:28 3.4s0 3:29c49be6:::smithi20431790-10:head [append 0~163840,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:57.180 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.201433260000002, 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039204422000000003, 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 28 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.181 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945486+0000", 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.182 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945810+0000", 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000323713 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945834+0000", 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3858000000000001e-05 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945851+0000", 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7099999999999999e-05 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.183 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965628+0000", 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019777501999999999 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965920+0000", 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00029198400000000002 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967512+0000", 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015920190000000001 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984489+0000", 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016976872 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984601+0000", 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000111969 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984689+0000", 2024-09-16T04:08:57.185 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7554999999999998e-05 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:29 3.4s0 3:29c49be6:::smithi20431790-10:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.201038656999998, 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041668905999999999, 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.186 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 29 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.187 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945880+0000", 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7060000000000001e-06 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945888+0000", 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8630000000000008e-06 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.188 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945906+0000", 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8165e-05 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945921+0000", 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4233000000000001e-05 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.969983+0000", 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.024062503999999998 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.189 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970182+0000", 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000198784 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.975849+0000", 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0056673210000000003 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984708+0000", 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088582690000000002 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.190 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987208+0000", 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0025007359999999999 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987548+0000", 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033932500000000002 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:30 3.4s0 3:29c49be6:::smithi20431790-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:08:57.191 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.200950962, 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044609479, 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 30 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.192 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945968+0000", 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5629999999999999e-06 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.193 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945975+0000", 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.063e-06 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945994+0000", 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9415999999999998e-05 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946009+0000", 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4969e-05 2024-09-16T04:08:57.194 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978603+0000", 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.032593521 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978799+0000", 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000196336 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.195 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987651+0000", 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088521820000000001 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987845+0000", 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019347900000000001 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990576+0000", 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027309499999999998 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:42 3.bs0 3:dfb3e098:::smithi20431790-14:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.193876971000002, 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030384648, 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.197 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 42 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953040+0000", 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.198 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953042+0000", 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2750000000000001e-06 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953049+0000", 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3819999999999998e-06 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953071+0000", 2024-09-16T04:08:57.199 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.213e-05 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953086+0000", 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4691e-05 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.966890+0000", 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013804448 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.200 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.968398+0000", 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015072379999999999 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977027+0000", 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086299559999999994 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.977565+0000", 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00053773700000000005 2024-09-16T04:08:57.201 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.983425+0000", 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058597909999999996 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:46 3.4s0 3:285c2ad8:::smithi20431790-16:head [append 0~262144,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.189565668999997, 2024-09-16T04:08:57.202 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.033667818000000002, 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 46 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.203 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957352+0000", 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957361+0000", 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8279999999999992e-06 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957823+0000", 2024-09-16T04:08:57.204 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000462912 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957847+0000", 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3329999999999999e-05 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7459999999999999e-05 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.205 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980701+0000", 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.022836372000000001 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980884+0000", 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018340000000000001 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982553+0000", 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0016689350000000001 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.206 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987566+0000", 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050129570000000002 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990888+0000", 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0033219679999999998 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991019+0000", 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013165599999999999 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.207 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:47 3.4s0 3:285c2ad8:::smithi20431790-16:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.189024170000003, 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.037486141000000001, 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.208 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 47 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.209 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957895+0000", 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6950000000000001e-06 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957903+0000", 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8679999999999999e-06 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.210 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957923+0000", 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0001e-05 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957942+0000", 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9368000000000002e-05 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985229+0000", 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027287148000000001 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.211 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985602+0000", 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037240199999999998 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986575+0000", 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00097305500000000001 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989838+0000", 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0032630300000000001 2024-09-16T04:08:57.212 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995213+0000", 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053754359999999999 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995379+0000", 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000166138 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.213 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:48 3.4s0 3:285c2ad8:::smithi20431790-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.188955475999997, 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041004387000000003, 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 48 2024-09-16T04:08:57.214 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.215 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957963+0000", 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.437e-06 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957969+0000", 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8370000000000002e-06 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957990+0000", 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0883999999999999e-05 2024-09-16T04:08:57.216 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958003+0000", 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3377000000000001e-05 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.988975+0000", 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030971772000000002 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989143+0000", 2024-09-16T04:08:57.217 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016802000000000001 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996033+0000", 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068901420000000001 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996181+0000", 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014787700000000001 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.218 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.998966+0000", 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027850409999999998 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:57 3.bs0 3:d6a8a443:::smithi20431790-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.174855209999997, 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027398674000000001, 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.219 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 57 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972062+0000", 2024-09-16T04:08:57.220 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972064+0000", 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6199999999999999e-06 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972089+0000", 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5650999999999999e-05 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.221 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972112+0000", 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2408999999999998e-05 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.972129+0000", 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7263999999999999e-05 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982377+0000", 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010247460999999999 2024-09-16T04:08:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.982554+0000", 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000177071 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995331+0000", 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012777227 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995447+0000", 2024-09-16T04:08:57.223 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011627400000000001 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.999461+0000", 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040136970000000001 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:406 3.bs0 3:de4d7231:::smithi20431790-45:head [read 0~3047424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:35.844070+0000", 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 21.302847408000002, 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.023954726999999999, 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 406 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.225 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844070+0000", 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844070+0000", 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844072+0000", 2024-09-16T04:08:57.226 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844080+0000", 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7329999999999992e-06 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844103+0000", 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2345999999999999e-05 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844119+0000", 2024-09-16T04:08:57.227 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6079999999999999e-05 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844369+0000", 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025003100000000001 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844385+0000", 2024-09-16T04:08:57.228 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5777000000000002e-05 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.849444+0000", 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050592329999999998 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.849668+0000", 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000224322 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.229 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.868025+0000", 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018356448000000001 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:407 3.bs0 3:de4d7231:::smithi20431790-45:head [read 0~3047424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:35.844175+0000", 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 21.302742804000001, 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.028643892000000001, 2024-09-16T04:08:57.230 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 407 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844175+0000", 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844175+0000", 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844176+0000", 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3030000000000001e-06 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844184+0000", 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0199999999999994e-06 2024-09-16T04:08:57.232 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844209+0000", 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5179000000000001e-05 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844223+0000", 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3929e-05 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844431+0000", 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020774300000000001 2024-09-16T04:08:57.233 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.844440+0000", 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3470000000000005e-06 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.853399+0000", 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089589700000000001 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.234 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.853689+0000", 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028963699999999998 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:35.872818+0000", 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019129764 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.235 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:477 3.bs0 3:dc3e14e2:::smithi20431790-29:head [copy-from ver 8] snapc 10=[10,f,c,a] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.859960+0000", 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.286956893999999, 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.042464367000000003, 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 477 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.236 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859960+0000", 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859960+0000", 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859964+0000", 2024-09-16T04:08:57.237 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3189999999999999e-06 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859978+0000", 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4724e-05 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860015+0000", 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6298999999999999e-05 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860039+0000", 2024-09-16T04:08:57.238 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4278999999999999e-05 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860194+0000", 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000154976 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "op must wait for map", 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860209+0000", 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5279000000000001e-05 2024-09-16T04:08:57.239 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864305+0000", 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040955130000000003 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864563+0000", 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025807299999999999 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.240 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.891237+0000", 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.026674131 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.901977+0000", 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010740387000000001 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.241 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.902163+0000", 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018583900000000001 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.902425+0000", 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026154800000000001 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.242 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:478 3.bs0 3:dc3e14e2:::smithi20431790-29:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.860089+0000", 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.286827970999999, 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.035771745000000001, 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 478 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.243 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860089+0000", 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860089+0000", 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860091+0000", 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.463e-06 2024-09-16T04:08:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860099+0000", 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0930000000000003e-06 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860121+0000", 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1702999999999999e-05 2024-09-16T04:08:57.245 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.246 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.246 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.246 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860164+0000", 2024-09-16T04:08:57.246 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.3639e-05 2024-09-16T04:08:57.246 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.246 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.247 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.247 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860364+0000", 2024-09-16T04:08:57.247 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019981400000000001 2024-09-16T04:08:57.247 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.247 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.247 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860383+0000", 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8522e-05 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864818+0000", 2024-09-16T04:08:57.248 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044352209999999996 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for blocked object", 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864897+0000", 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9128000000000005e-05 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.249 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.895268+0000", 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030371056 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.895547+0000", 2024-09-16T04:08:57.250 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00027891800000000002 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.895861+0000", 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00031418800000000002 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.251 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.252 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.252 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.252 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.252 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs1 64/31 ECSubWrite(tid=112, reqid=osd.5.0:112, at_version=64'56, trim_to=0'0, roll_forward_to=63'54))", 2024-09-16T04:08:57.252 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.900895+0000", 2024-09-16T04:08:57.252 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.246022545000001, 2024-09-16T04:08:57.253 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027283643999999999, 2024-09-16T04:08:57.253 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.253 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.253 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.253 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.253 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.254 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.254 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.900895+0000", 2024-09-16T04:08:57.254 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.254 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.254 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.254 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.900895+0000", 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.900896+0000", 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.9299999999999996e-07 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.900944+0000", 2024-09-16T04:08:57.255 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8343000000000001e-05 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.900967+0000", 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2991999999999999e-05 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.900990+0000", 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2787000000000001e-05 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.256 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902833+0000", 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0018431560000000001 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.902857+0000", 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3716000000000001e-05 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928089+0000", 2024-09-16T04:08:57.257 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.025232790000000001 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928178+0000", 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8967000000000004e-05 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs1 64/31 ECSubWrite(tid=113, reqid=osd.5.0:113, at_version=64'58, trim_to=0'0, roll_forward_to=63'54))", 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.903135+0000", 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.243781929000001, 2024-09-16T04:08:57.258 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.02510103, 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.903135+0000", 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.903135+0000", 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.259 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.903137+0000", 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.457e-06 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.903186+0000", 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8726000000000001e-05 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.260 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.903212+0000", 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6472e-05 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.903234+0000", 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1610000000000001e-05 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909294+0000", 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0060604819999999998 2024-09-16T04:08:57.261 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909320+0000", 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5548999999999999e-05 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928186+0000", 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018866382000000001 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928236+0000", 2024-09-16T04:08:57.262 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.0352000000000002e-05 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(osd.11.22:2 3.4s0 3:285c2ad8:::smithi20431790-16:head [assert-version v78,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.913639+0000", 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.233278143, 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.029326794, 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.263 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913639+0000", 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913639+0000", 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913643+0000", 2024-09-16T04:08:57.264 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.653e-06 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913676+0000", 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3068999999999998e-05 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913738+0000", 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2168999999999994e-05 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.265 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.913762+0000", 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4059000000000001e-05 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.927791+0000", 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.014028752 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928061+0000", 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026989599999999999 2024-09-16T04:08:57.266 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.937938+0000", 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098768050000000007 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.938207+0000", 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026902300000000002 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.942966+0000", 2024-09-16T04:08:57.267 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0047593679999999999 2024-09-16T04:08:57.268 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.268 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.268 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.268 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.268 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.268 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:57.272 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:08:57.273 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:08:57.275 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:08:57.277 INFO:tasks.rados.rados.0.smithi204.stdout:288: finishing write tid 2 to smithi20431790-23 2024-09-16T04:08:57.277 INFO:tasks.rados.rados.0.smithi204.stdout:289: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-16T04:08:57.277 INFO:tasks.rados.rados.0.smithi204.stdout:288: finishing write tid 3 to smithi20431790-23 2024-09-16T04:08:57.278 INFO:tasks.rados.rados.0.smithi204.stdout:288: finishing write tid 4 to smithi20431790-23 2024-09-16T04:08:57.278 INFO:tasks.rados.rados.0.smithi204.stdout:288: finishing write tid 5 to smithi20431790-23 2024-09-16T04:08:57.278 INFO:tasks.rados.rados.0.smithi204.stdout:281: done (6 left) 2024-09-16T04:08:57.278 INFO:tasks.rados.rados.0.smithi204.stdout:289: done (5 left) 2024-09-16T04:08:57.278 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 12 current snap is 22 2024-09-16T04:08:57.279 INFO:tasks.rados.rados.0.smithi204.stdout:288: finishing write tid 6 to smithi20431790-23 2024-09-16T04:08:57.279 INFO:tasks.rados.rados.0.smithi204.stdout:288: oid 23 updating version 0 to 22 2024-09-16T04:08:57.279 INFO:tasks.rados.rados.0.smithi204.stdout:288: oid 23 version 22 is already newer than 20 2024-09-16T04:08:57.279 INFO:tasks.rados.rados.0.smithi204.stdout:288: oid 23 version 22 is already newer than 21 2024-09-16T04:08:57.280 INFO:tasks.rados.rados.0.smithi204.stdout:288: oid 23 version 22 is already newer than 18 2024-09-16T04:08:57.280 INFO:tasks.rados.rados.0.smithi204.stdout:288: oid 23 version 22 is already newer than 19 2024-09-16T04:08:57.280 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 23 v 22 (ObjNum 124 snap 22 seq_num 124) dirty exists 2024-09-16T04:08:57.280 INFO:tasks.rados.rados.0.smithi204.stdout:288: left oid 23 (ObjNum 124 snap 22 seq_num 124) 2024-09-16T04:08:57.280 INFO:tasks.rados.rados.0.smithi204.stdout:293: finishing rollback tid 1 to smithi20431790-17 2024-09-16T04:08:57.281 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 17 v 0 (ObjNum 2289 snap 0 seq_num 2595885568) dirty dne 2024-09-16T04:08:57.281 INFO:tasks.rados.rados.0.smithi204.stdout:294: finishing write tid 1 to smithi20431790-49 2024-09-16T04:08:57.281 INFO:tasks.rados.rados.0.smithi204.stdout:297: seq_num 127 ranges {1605632=589824,2195456=753664,2949120=475136,3424256=327680} 2024-09-16T04:08:57.281 INFO:tasks.rados.rados.0.smithi204.stdout:297: writing smithi20431790-12 from 1605632 to 2195456 tid 1 2024-09-16T04:08:57.281 INFO:tasks.rados.rados.0.smithi204.stdout:297: writing smithi20431790-12 from 2195456 to 2949120 tid 2 2024-09-16T04:08:57.282 INFO:tasks.rados.rados.0.smithi204.stdout:297: writing smithi20431790-12 from 2949120 to 3424256 tid 3 2024-09-16T04:08:57.282 INFO:tasks.rados.rados.0.smithi204.stdout:297: writing smithi20431790-12 from 3424256 to 3751936 tid 4 2024-09-16T04:08:57.282 INFO:tasks.rados.rados.0.smithi204.stdout:288: done (5 left) 2024-09-16T04:08:57.282 INFO:tasks.rados.rados.0.smithi204.stdout:293: done (4 left) 2024-09-16T04:08:57.282 INFO:tasks.rados.rados.0.smithi204.stdout:298: rmattr oid 50 current snap is 22 2024-09-16T04:08:57.283 INFO:tasks.rados.rados.0.smithi204.stdout:294: finishing write tid 2 to smithi20431790-49 2024-09-16T04:08:57.283 INFO:tasks.rados.rados.0.smithi204.stdout:294: finishing write tid 3 to smithi20431790-49 2024-09-16T04:08:57.283 INFO:tasks.rados.rados.0.smithi204.stdout:294: finishing write tid 4 to smithi20431790-49 2024-09-16T04:08:57.283 INFO:tasks.rados.rados.0.smithi204.stdout:294: finishing write tid 5 to smithi20431790-49 2024-09-16T04:08:57.283 INFO:tasks.rados.rados.0.smithi204.stdout:294: finishing write tid 6 to smithi20431790-49 2024-09-16T04:08:57.283 INFO:tasks.rados.rados.0.smithi204.stdout:294: oid 49 updating version 0 to 110 2024-09-16T04:08:57.284 INFO:tasks.rados.rados.0.smithi204.stdout:294: oid 49 updating version 110 to 111 2024-09-16T04:08:57.284 INFO:tasks.rados.rados.0.smithi204.stdout:294: oid 49 version 111 is already newer than 108 2024-09-16T04:08:57.284 INFO:tasks.rados.rados.0.smithi204.stdout:294: oid 49 version 111 is already newer than 107 2024-09-16T04:08:57.284 INFO:tasks.rados.rados.0.smithi204.stdout:294: oid 49 version 111 is already newer than 109 2024-09-16T04:08:57.284 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 111 (ObjNum 126 snap 22 seq_num 126) dirty exists 2024-09-16T04:08:57.285 INFO:tasks.rados.rados.0.smithi204.stdout:294: left oid 49 (ObjNum 126 snap 22 seq_num 126) 2024-09-16T04:08:57.285 INFO:tasks.rados.rados.0.smithi204.stdout:295: finishing copy_from racing read to smithi20431790-43 2024-09-16T04:08:57.285 INFO:tasks.rados.rados.0.smithi204.stdout:295: finishing copy_from to smithi20431790-43 2024-09-16T04:08:57.285 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 43 v 13 (ObjNum 66 snap 4 seq_num 66) dirty exists 2024-09-16T04:08:57.285 INFO:tasks.rados.rados.0.smithi204.stdout:294: done (4 left) 2024-09-16T04:08:57.286 INFO:tasks.rados.rados.0.smithi204.stdout:295: done (3 left) 2024-09-16T04:08:57.286 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 6 current snap is 22 2024-09-16T04:08:57.286 INFO:tasks.rados.rados.0.smithi204.stdout:296: finishing copy_from racing read to smithi20431790-34 2024-09-16T04:08:57.286 INFO:tasks.rados.rados.0.smithi204.stdout:296: finishing copy_from to smithi20431790-34 2024-09-16T04:08:57.286 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 34 v 46 (ObjNum 79 snap 7 seq_num 79) dirty exists 2024-09-16T04:08:57.286 INFO:tasks.rados.rados.0.smithi204.stdout:299: seq_num 128 ranges {1851392=606208,2457600=507904,2965504=573440,3538944=475136} 2024-09-16T04:08:57.287 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:57.263+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:57.288 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-16T04:08:56.852504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63521331,"num_objects":46,"num_object_clones":1,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":491,"num_read_kb":131201,"num_write":754,"num_write_kb":99078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":876,"ondisk_log_size":876,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":604124,"kb_used_data":125672,"kb_used_omap":24,"kb_used_meta":477863,"kb_avail":1509345316,"statfs":{"total":1546188226560,"available":1545569603584,"internally_reserved":0,"allocated":128688128,"data_stored":122075406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":489331791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,3,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1998848,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":821,"num_write":39,"num_write_kb":7264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003637"},"pg_stats":[{"pgid":"3.f","version":"64'41","reported_seq":259,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.255821+0000","last_change":"2024-09-16T04:08:50.873242+0000","last_active":"2024-09-16T04:08:54.255821+0000","last_peered":"2024-09-16T04:08:54.255821+0000","last_clean":"2024-09-16T04:08:54.255821+0000","last_became_active":"2024-09-16T04:08:14.947752+0000","last_became_peered":"2024-09-16T04:08:14.947752+0000","last_unstale":"2024-09-16T04:08:54.255821+0000","last_undegraded":"2024-09-16T04:08:54.255821+0000","last_fullsized":"2024-09-16T04:08:54.255821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:37.227572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003394322,"stat_sum":{"num_bytes":2457600,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":12682,"num_write":14,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,4,11,7,10,2],"acting":[13,12,4,11,7,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"3.e","version":"64'40","reported_seq":251,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.872562+0000","last_change":"2024-09-16T04:08:50.868531+0000","last_active":"2024-09-16T04:08:54.872562+0000","last_peered":"2024-09-16T04:08:54.872562+0000","last_clean":"2024-09-16T04:08:54.872562+0000","last_became_active":"2024-09-16T04:08:15.495259+0000","last_became_peered":"2024-09-16T04:08:15.495259+0000","last_unstale":"2024-09-16T04:08:54.872562+0000","last_undegraded":"2024-09-16T04:08:54.872562+0000","last_fullsized":"2024-09-16T04:08:54.872562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:24.350404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075080100000000005,"stat_sum":{"num_bytes":4341760,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":20793,"num_write":19,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,4,13,2,0,15],"acting":[8,11,4,13,2,0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"12","length":"1"}]},{"pgid":"3.d","version":"64'17","reported_seq":216,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.255701+0000","last_change":"2024-09-16T04:08:50.871966+0000","last_active":"2024-09-16T04:08:54.255701+0000","last_peered":"2024-09-16T04:08:54.255701+0000","last_clean":"2024-09-16T04:08:54.255701+0000","last_became_active":"2024-09-16T04:08:15.857514+0000","last_became_peered":"2024-09-16T04:08:15.857514+0000","last_unstale":"2024-09-16T04:08:54.255701+0000","last_undegraded":"2024-09-16T04:08:54.255701+0000","last_fullsized":"2024-09-16T04:08:54.255701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.515114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001989162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":7,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,0,12,9,2,6],"acting":[13,1,0,12,9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"3.c","version":"66'59","reported_seq":260,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.852817+0000","last_change":"2024-09-16T04:08:50.848645+0000","last_active":"2024-09-16T04:08:53.852817+0000","last_peered":"2024-09-16T04:08:53.852817+0000","last_clean":"2024-09-16T04:08:53.852817+0000","last_became_active":"2024-09-16T04:08:14.948022+0000","last_became_peered":"2024-09-16T04:08:14.948022+0000","last_unstale":"2024-09-16T04:08:53.852817+0000","last_undegraded":"2024-09-16T04:08:53.852817+0000","last_fullsized":"2024-09-16T04:08:53.852817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:33.209590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020134269999999999,"stat_sum":{"num_bytes":6979584,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":11000,"num_write":42,"num_write_kb":8944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,13,12,4,2,6],"acting":[5,10,13,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"3.b","version":"68'164","reported_seq":381,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.855166+0000","last_change":"2024-09-16T04:08:50.877820+0000","last_active":"2024-09-16T04:08:53.855166+0000","last_peered":"2024-09-16T04:08:53.855166+0000","last_clean":"2024-09-16T04:08:53.855166+0000","last_became_active":"2024-09-16T04:08:15.856491+0000","last_became_peered":"2024-09-16T04:08:15.856491+0000","last_unstale":"2024-09-16T04:08:53.855166+0000","last_undegraded":"2024-09-16T04:08:53.855166+0000","last_fullsized":"2024-09-16T04:08:53.855166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:29.469427+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.016202841999999999,"stat_sum":{"num_bytes":9175040,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":21837,"num_write":149,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,11,15,8,1,14],"acting":[10,6,11,15,8,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"3.a","version":"66'51","reported_seq":260,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.255279+0000","last_change":"2024-09-16T04:08:50.874885+0000","last_active":"2024-09-16T04:08:54.255279+0000","last_peered":"2024-09-16T04:08:54.255279+0000","last_clean":"2024-09-16T04:08:54.255279+0000","last_became_active":"2024-09-16T04:08:15.858613+0000","last_became_peered":"2024-09-16T04:08:15.858613+0000","last_unstale":"2024-09-16T04:08:54.255279+0000","last_undegraded":"2024-09-16T04:08:54.255279+0000","last_fullsized":"2024-09-16T04:08:54.255279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:35.345248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003788292,"stat_sum":{"num_bytes":2867200,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":3559,"num_write":20,"num_write_kb":3792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,8,9,0],"acting":[13,1,7,5,8,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"3.9","version":"68'26","reported_seq":222,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.852879+0000","last_change":"2024-09-16T04:08:50.854404+0000","last_active":"2024-09-16T04:08:53.852879+0000","last_peered":"2024-09-16T04:08:53.852879+0000","last_clean":"2024-09-16T04:08:53.852879+0000","last_became_active":"2024-09-16T04:08:14.936519+0000","last_became_peered":"2024-09-16T04:08:14.936519+0000","last_unstale":"2024-09-16T04:08:53.852879+0000","last_undegraded":"2024-09-16T04:08:53.852879+0000","last_fullsized":"2024-09-16T04:08:53.852879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:41.456876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023786300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":1712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,14,4,5,10,6],"acting":[12,11,14,4,5,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"3.8","version":"70'39","reported_seq":245,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.855247+0000","last_change":"2024-09-16T04:08:52.866624+0000","last_active":"2024-09-16T04:08:53.855247+0000","last_peered":"2024-09-16T04:08:53.855247+0000","last_clean":"2024-09-16T04:08:53.855247+0000","last_became_active":"2024-09-16T04:08:52.864471+0000","last_became_peered":"2024-09-16T04:08:52.864471+0000","last_unstale":"2024-09-16T04:08:53.855247+0000","last_undegraded":"2024-09-16T04:08:53.855247+0000","last_fullsized":"2024-09-16T04:08:53.855247+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:34.906527+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.019181658000000001,"stat_sum":{"num_bytes":2850816,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":1304,"num_write":18,"num_write_kb":6384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,0,15,14,1,4],"acting":[11,10,0,15,14,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"1.0","version":"27'157","reported_seq":297,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.254302+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:08:54.254302+0000","last_peered":"2024-09-16T04:08:54.254302+0000","last_clean":"2024-09-16T04:08:54.254302+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:08:54.254302+0000","last_undegraded":"2024-09-16T04:08:54.254302+0000","last_fullsized":"2024-09-16T04:08:54.254302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":107,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.254618+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:08:54.254618+0000","last_peered":"2024-09-16T04:08:54.254618+0000","last_clean":"2024-09-16T04:08:54.254618+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:08:54.254618+0000","last_undegraded":"2024-09-16T04:08:54.254618+0000","last_fullsized":"2024-09-16T04:08:54.254618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"68'71","reported_seq":281,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.254517+0000","last_change":"2024-09-16T04:08:50.855556+0000","last_active":"2024-09-16T04:08:54.254517+0000","last_peered":"2024-09-16T04:08:54.254517+0000","last_clean":"2024-09-16T04:08:54.254517+0000","last_became_active":"2024-09-16T04:08:15.856679+0000","last_became_peered":"2024-09-16T04:08:15.856679+0000","last_unstale":"2024-09-16T04:08:54.254517+0000","last_undegraded":"2024-09-16T04:08:54.254517+0000","last_fullsized":"2024-09-16T04:08:54.254517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:13.997114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049839399999999999,"stat_sum":{"num_bytes":7995392,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":12638,"num_write":41,"num_write_kb":9712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,13,1,5,3,7],"acting":[11,12,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.951904+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:08:53.951904+0000","last_peered":"2024-09-16T04:08:53.951904+0000","last_clean":"2024-09-16T04:08:53.951904+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:08:53.951904+0000","last_undegraded":"2024-09-16T04:08:53.951904+0000","last_fullsized":"2024-09-16T04:08:53.951904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"66'11","reported_seq":218,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.876471+0000","last_change":"2024-09-16T04:08:50.861127+0000","last_active":"2024-09-16T04:08:54.876471+0000","last_peered":"2024-09-16T04:08:54.876471+0000","last_clean":"2024-09-16T04:08:54.876471+0000","last_became_active":"2024-09-16T04:08:15.495747+0000","last_became_peered":"2024-09-16T04:08:15.495747+0000","last_unstale":"2024-09-16T04:08:54.876471+0000","last_undegraded":"2024-09-16T04:08:54.876471+0000","last_fullsized":"2024-09-16T04:08:54.876471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:35.620190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002060376,"stat_sum":{"num_bytes":1605632,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4708,"num_write":8,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13,3,11,12,0,7],"acting":[6,13,3,11,12,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.871098+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:08:54.871098+0000","last_peered":"2024-09-16T04:08:54.871098+0000","last_clean":"2024-09-16T04:08:54.871098+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:08:54.871098+0000","last_undegraded":"2024-09-16T04:08:54.871098+0000","last_fullsized":"2024-09-16T04:08:54.871098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"70'35","reported_seq":242,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.852788+0000","last_change":"2024-09-16T04:08:50.852646+0000","last_active":"2024-09-16T04:08:53.852788+0000","last_peered":"2024-09-16T04:08:53.852788+0000","last_clean":"2024-09-16T04:08:53.852788+0000","last_became_active":"2024-09-16T04:08:15.466434+0000","last_became_peered":"2024-09-16T04:08:15.466434+0000","last_unstale":"2024-09-16T04:08:53.852788+0000","last_undegraded":"2024-09-16T04:08:53.852788+0000","last_fullsized":"2024-09-16T04:08:53.852788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:23.123798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081572899999999995,"stat_sum":{"num_bytes":2506752,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":8744,"num_write":54,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,5,9,3,13,11,6],"acting":[12,5,9,3,13,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"2.2","version":"27'2","reported_seq":109,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.255281+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:08:54.255281+0000","last_peered":"2024-09-16T04:08:54.255281+0000","last_clean":"2024-09-16T04:08:54.255281+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:08:54.255281+0000","last_undegraded":"2024-09-16T04:08:54.255281+0000","last_fullsized":"2024-09-16T04:08:54.255281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"68'36","reported_seq":250,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.872290+0000","last_change":"2024-09-16T04:08:50.845386+0000","last_active":"2024-09-16T04:08:54.872290+0000","last_peered":"2024-09-16T04:08:54.872290+0000","last_clean":"2024-09-16T04:08:54.872290+0000","last_became_active":"2024-09-16T04:08:14.946050+0000","last_became_peered":"2024-09-16T04:08:14.946050+0000","last_unstale":"2024-09-16T04:08:54.872290+0000","last_undegraded":"2024-09-16T04:08:54.872290+0000","last_fullsized":"2024-09-16T04:08:54.872290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.357919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042696999999999999,"stat_sum":{"num_bytes":5914624,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":10379,"num_write":24,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,2,13,4,6,5],"acting":[15,9,2,13,4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"12","length":"1"}]},{"pgid":"3.5","version":"54'16","reported_seq":242,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.852790+0000","last_change":"2024-09-16T04:08:50.848357+0000","last_active":"2024-09-16T04:08:53.852790+0000","last_peered":"2024-09-16T04:08:53.852790+0000","last_clean":"2024-09-16T04:08:53.852790+0000","last_became_active":"2024-09-16T04:08:14.934767+0000","last_became_peered":"2024-09-16T04:08:14.934767+0000","last_unstale":"2024-09-16T04:08:53.852790+0000","last_undegraded":"2024-09-16T04:08:53.852790+0000","last_fullsized":"2024-09-16T04:08:53.852790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:39.323156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001797625,"stat_sum":{"num_bytes":1867776,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":9878,"num_write":30,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,14,9,10,13,8],"acting":[5,6,14,9,10,13,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.876052+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:08:54.876052+0000","last_peered":"2024-09-16T04:08:54.876052+0000","last_clean":"2024-09-16T04:08:54.876052+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:08:54.876052+0000","last_undegraded":"2024-09-16T04:08:54.876052+0000","last_fullsized":"2024-09-16T04:08:54.876052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"66'95","reported_seq":297,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:53.855377+0000","last_change":"2024-09-16T04:08:50.863968+0000","last_active":"2024-09-16T04:08:53.855377+0000","last_peered":"2024-09-16T04:08:53.855377+0000","last_clean":"2024-09-16T04:08:53.855377+0000","last_became_active":"2024-09-16T04:08:15.495248+0000","last_became_peered":"2024-09-16T04:08:15.495248+0000","last_unstale":"2024-09-16T04:08:53.855377+0000","last_undegraded":"2024-09-16T04:08:53.855377+0000","last_fullsized":"2024-09-16T04:08:53.855377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.600636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019993139999999999,"stat_sum":{"num_bytes":12615680,"num_objects":6,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":104,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,3,15,6,0],"acting":[10,12,14,3,15,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"c","length":"1"},{"start":"f","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.872266+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:54.872266+0000","last_peered":"2024-09-16T04:08:54.872266+0000","last_clean":"2024-09-16T04:08:54.872266+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:54.872266+0000","last_undegraded":"2024-09-16T04:08:54.872266+0000","last_fullsized":"2024-09-16T04:08:54.872266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":208,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.876452+0000","last_change":"2024-09-16T04:08:50.848938+0000","last_active":"2024-09-16T04:08:54.876452+0000","last_peered":"2024-09-16T04:08:54.876452+0000","last_clean":"2024-09-16T04:08:54.876452+0000","last_became_active":"2024-09-16T04:08:14.939313+0000","last_became_peered":"2024-09-16T04:08:14.939313+0000","last_unstale":"2024-09-16T04:08:54.876452+0000","last_undegraded":"2024-09-16T04:08:54.876452+0000","last_fullsized":"2024-09-16T04:08:54.876452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:33.771644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001089196,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":3747,"num_write":2,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8,7,4,11,6,13],"acting":[14,8,7,4,11,6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"12","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.874907+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:08:54.874907+0000","last_peered":"2024-09-16T04:08:54.874907+0000","last_clean":"2024-09-16T04:08:54.874907+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:08:54.874907+0000","last_undegraded":"2024-09-16T04:08:54.874907+0000","last_fullsized":"2024-09-16T04:08:54.874907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"42'13","reported_seq":221,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.875461+0000","last_change":"2024-09-16T04:08:50.849401+0000","last_active":"2024-09-16T04:08:54.875461+0000","last_peered":"2024-09-16T04:08:54.875461+0000","last_clean":"2024-09-16T04:08:54.875461+0000","last_became_active":"2024-09-16T04:08:15.494877+0000","last_became_peered":"2024-09-16T04:08:15.494877+0000","last_unstale":"2024-09-16T04:08:54.875461+0000","last_undegraded":"2024-09-16T04:08:54.875461+0000","last_fullsized":"2024-09-16T04:08:54.875461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:42.661934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013011209999999999,"stat_sum":{"num_bytes":1114112,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":9797,"num_write":6,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7,15,5,11,9,0],"acting":[14,7,15,5,11,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"12","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T04:08:54.256118+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:08:54.256118+0000","last_peered":"2024-09-16T04:08:54.256118+0000","last_clean":"2024-09-16T04:08:54.256118+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:08:54.256118+0000","last_undegraded":"2024-09-16T04:08:54.256118+0000","last_fullsized":"2024-09-16T04:08:54.256118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":62930944,"num_objects":42,"num_object_clones":1,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":355,"num_read_kb":131083,"num_write":549,"num_write_kb":95616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112046080,"data_stored":112304128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":716,"ondisk_log_size":716,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247821,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":10244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":10489856,"data_stored":10092237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247822,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39432,"kb_used_data":8068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332408,"statfs":{"total":96636764160,"available":96596385792,"internally_reserved":0,"allocated":8261632,"data_stored":7864013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247822,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44660,"kb_used_data":9308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327180,"statfs":{"total":96636764160,"available":96591032320,"internally_reserved":0,"allocated":9531392,"data_stored":9102900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313230,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":5760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":5898240,"data_stored":5475811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280526,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33576,"kb_used_data":6540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338264,"statfs":{"total":96636764160,"available":96602382336,"internally_reserved":0,"allocated":6696960,"data_stored":6311395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280526,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39300,"kb_used_data":8108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":8302592,"data_stored":7874100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280527,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":5024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":5144576,"data_stored":4722147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280527,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":4452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":4558848,"data_stored":4130356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280527,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36776,"kb_used_data":9748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335064,"statfs":{"total":96636764160,"available":96599105536,"internally_reserved":0,"allocated":9981952,"data_stored":9586247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,3,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280527,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40644,"kb_used_data":9452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331196,"statfs":{"total":96636764160,"available":96595144704,"internally_reserved":0,"allocated":9678848,"data_stored":9289731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280526,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":10032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":10272768,"data_stored":9846262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247821,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38892,"kb_used_data":7704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332948,"statfs":{"total":96636764160,"available":96596938752,"internally_reserved":0,"allocated":7888896,"data_stored":7487725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247823,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34036,"kb_used_data":7004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337804,"statfs":{"total":96636764160,"available":96601911296,"internally_reserved":0,"allocated":7172096,"data_stored":6743604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247821,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37820,"kb_used_data":6628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334020,"statfs":{"total":96636764160,"available":96598036480,"internally_reserved":0,"allocated":6787072,"data_stored":6395444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247822,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42732,"kb_used_data":11536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329108,"statfs":{"total":96636764160,"available":96593006592,"internally_reserved":0,"allocated":11812864,"data_stored":11378381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247821,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41420,"kb_used_data":6064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330420,"statfs":{"total":96636764160,"available":96594350080,"internally_reserved":0,"allocated":6209536,"data_stored":5775053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6348800,"data_stored":6385664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5722112,"data_stored":5758976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4923392,"data_stored":4923392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6180864,"data_stored":6180864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":5832704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7311360,"data_stored":7311360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":10805248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4169728,"data_stored":4169728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5201920,"data_stored":5201920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":3567616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8986624,"data_stored":9023488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8171520,"data_stored":8208384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":8540160,"data_stored":8540160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":9293824,"data_stored":9293824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":7544832,"data_stored":7581696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":9482240,"data_stored":9519104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:08:57.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pgp_num 16 2024-09-16T04:08:57.292 INFO:tasks.rados.rados.0.smithi204.stdout:299: writing smithi20431790-6 from 1851392 to 2457600 tid 1 2024-09-16T04:08:57.292 INFO:tasks.rados.rados.0.smithi204.stdout:299: writing smithi20431790-6 from 2457600 to 2965504 tid 2 2024-09-16T04:08:57.294 INFO:tasks.rados.rados.0.smithi204.stdout:299: writing smithi20431790-6 from 2965504 to 3538944 tid 3 2024-09-16T04:08:57.299 INFO:tasks.rados.rados.0.smithi204.stdout:299: writing smithi20431790-6 from 3538944 to 4014080 tid 4 2024-09-16T04:08:57.299 INFO:tasks.rados.rados.0.smithi204.stdout:296: done (3 left) 2024-09-16T04:08:57.299 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 47 current snap is 22 2024-09-16T04:08:57.299 INFO:tasks.rados.rados.0.smithi204.stdout:297: finishing write tid 1 to smithi20431790-12 2024-09-16T04:08:57.299 INFO:tasks.rados.rados.0.smithi204.stdout:300: seq_num 129 ranges {0=622592,622592=655360,1277952=688128,1966080=212992} 2024-09-16T04:08:57.303 INFO:tasks.rados.rados.0.smithi204.stdout:300: writing smithi20431790-47 from 0 to 622592 tid 1 2024-09-16T04:08:57.308 INFO:tasks.rados.rados.0.smithi204.stdout:300: writing smithi20431790-47 from 622592 to 1277952 tid 2 2024-09-16T04:08:57.312 INFO:tasks.rados.rados.0.smithi204.stdout:300: writing smithi20431790-47 from 1277952 to 1966080 tid 3 2024-09-16T04:08:57.314 INFO:tasks.rados.rados.0.smithi204.stdout:300: writing smithi20431790-47 from 1966080 to 2179072 tid 4 2024-09-16T04:08:57.314 INFO:tasks.rados.rados.0.smithi204.stdout:301: snap_remove snap 20 2024-09-16T04:08:57.371 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:08:57.367+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:08:57.414 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:57.414 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:57.414 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:08:57.414 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:57.428 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:08:57.472 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:08:57.469+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:08:57.551 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:57.551 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:08:57.551 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:08:57.551 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:08:57.551 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:57.566 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:08:57.572 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:08:57.569+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:08:57.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:57.670+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.742783998999997, 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013450198999999999, 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.688 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.689 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942097+0000", 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.2600000000000001e-07 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942125+0000", 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8059e-05 2024-09-16T04:08:57.690 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942143+0000", 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8116000000000001e-05 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942165+0000", 2024-09-16T04:08:57.691 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1959000000000001e-05 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943008+0000", 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00084321400000000001 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.692 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943028+0000", 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0132999999999998e-05 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955472+0000", 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012443511000000001 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4281000000000003e-05 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.693 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=3, reqid=client.4631.0:22, at_version=33'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.738275367, 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01145176, 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.694 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.695 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946606+0000", 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5939999999999999e-06 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946710+0000", 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010391399999999999 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.696 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948852+0000", 2024-09-16T04:08:57.697 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0021415980000000002 2024-09-16T04:08:57.697 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.697 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.697 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.698 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948878+0000", 2024-09-16T04:08:57.698 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.597e-05 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948998+0000", 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120791 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949037+0000", 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8680000000000002e-05 2024-09-16T04:08:57.699 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957977+0000", 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089400739999999992 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958056+0000", 2024-09-16T04:08:57.700 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9139000000000002e-05 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=4, reqid=client.4631.0:23, at_version=33'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.735915378999998, 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0091600550000000003, 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.701 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948964+0000", 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.702 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.703 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.703 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948966+0000", 2024-09-16T04:08:57.703 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.297e-06 2024-09-16T04:08:57.703 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.703 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.703 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949000+0000", 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4164e-05 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949155+0000", 2024-09-16T04:08:57.704 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015466000000000001 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949174+0000", 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9658999999999999e-05 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950232+0000", 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0010573970000000001 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.705 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.950253+0000", 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1172999999999999e-05 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958067+0000", 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078142119999999992 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958124+0000", 2024-09-16T04:08:57.706 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7493e-05 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:105 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:57.707 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 40.659913267999997, 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092492909999999998, 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 105 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.708 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.709 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024967+0000", 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3600000000000003e-07 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024972+0000", 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.7140000000000001e-06 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024982+0000", 2024-09-16T04:08:57.710 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9620000000000005e-06 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.024990+0000", 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5680000000000002e-06 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028098+0000", 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031086120000000002 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.711 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.028201+0000", 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010293099999999999 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031909+0000", 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003707587 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.712 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.031957+0000", 2024-09-16T04:08:57.713 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8812e-05 2024-09-16T04:08:57.713 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.713 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.713 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.713 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.034216+0000", 2024-09-16T04:08:57.713 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0022583690000000001 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:420 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.094736+0000", 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 21.590143421000001, 2024-09-16T04:08:57.714 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090100189999999993, 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 420 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.715 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094736+0000", 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094736+0000", 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.716 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094738+0000", 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1999999999999999e-06 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094747+0000", 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7799999999999995e-06 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.717 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094775+0000", 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7602000000000001e-05 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094785+0000", 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9499999999999996e-06 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.096701+0000", 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0019158339999999999 2024-09-16T04:08:57.718 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.097017+0000", 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00031663299999999998 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.103746+0000", 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0067290199999999996 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.719 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:421 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 21.590013777999999, 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013252471, 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.720 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 421 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.721 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094867+0000", 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1999999999999998e-07 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.722 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094872+0000", 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.9590000000000003e-06 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094883+0000", 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1616e-05 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094895+0000", 2024-09-16T04:08:57.723 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1226999999999999e-05 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.103881+0000", 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089864100000000002 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.104033+0000", 2024-09-16T04:08:57.724 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000152342 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.108118+0000", 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040850970000000002 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.725 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 54/31 ECSubWrite(tid=70, reqid=osd.12.0:69, at_version=0'0, trim_to=0'0, roll_forward_to=54'25))", 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 20.614500994, 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098073039999999993, 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.726 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.727 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070381+0000", 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0999999999999998e-06 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070410+0000", 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8619000000000002e-05 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070469+0000", 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9508e-05 2024-09-16T04:08:57.728 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070492+0000", 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3373000000000001e-05 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070735+0000", 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024256899999999999 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.729 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070760+0000", 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4825999999999999e-05 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080100+0000", 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093401479999999995 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080186+0000", 2024-09-16T04:08:57.730 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6161000000000004e-05 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.071900+0000", 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 20.612979427999999, 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087262239999999994, 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.731 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071900+0000", 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071900+0000", 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071901+0000", 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5599999999999995e-07 2024-09-16T04:08:57.732 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072005+0000", 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000104143 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072036+0000", 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0833000000000001e-05 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072059+0000", 2024-09-16T04:08:57.733 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2643e-05 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072247+0000", 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018837699999999999 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.072274+0000", 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7469000000000001e-05 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080491+0000", 2024-09-16T04:08:57.734 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0082170969999999996 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080627+0000", 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013510599999999999 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/31 ECSubWrite(tid=211, reqid=osd.10.0:211, at_version=60'104, trim_to=0'0, roll_forward_to=57'102))", 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.876358+0000", 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.808522013999999, 2024-09-16T04:08:57.735 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093433200000000004, 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876358+0000", 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876358+0000", 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.736 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876360+0000", 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0499999999999999e-06 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876425+0000", 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.5174999999999999e-05 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.737 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876469+0000", 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.4221999999999998e-05 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876495+0000", 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5582999999999999e-05 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876710+0000", 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021554000000000001 2024-09-16T04:08:57.738 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.876727+0000", 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6362999999999999e-05 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.885590+0000", 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088633710000000001 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.885701+0000", 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000111016 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/31 ECSubWrite(tid=212, reqid=osd.10.0:212, at_version=60'106, trim_to=0'0, roll_forward_to=57'102))", 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.877995+0000", 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.806884321, 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010951160999999999, 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.740 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.877995+0000", 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.877995+0000", 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.741 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.877997+0000", 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9939999999999999e-06 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878050+0000", 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2037999999999999e-05 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878087+0000", 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7595999999999997e-05 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.742 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878110+0000", 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3289e-05 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878280+0000", 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016937899999999999 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878312+0000", 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2005000000000003e-05 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.743 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888841+0000", 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01052931 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888947+0000", 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010555 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 60/31 ECSubWrite(tid=213, reqid=osd.10.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=60'66))", 2024-09-16T04:08:57.744 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.879639+0000", 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.805240307, 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.009419574, 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879639+0000", 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.745 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879639+0000", 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879642+0000", 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.057e-06 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.746 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879674+0000", 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2202000000000001e-05 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879706+0000", 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2202000000000001e-05 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879730+0000", 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3753000000000001e-05 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.747 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879883+0000", 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000152979 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879908+0000", 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5686000000000001e-05 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.748 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888977+0000", 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090684370000000004 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889059+0000", 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2257999999999997e-05 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.749 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 64/31 ECSubWrite(tid=269, reqid=osd.10.0:269, at_version=64'142, trim_to=0'0, roll_forward_to=63'138))", 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908152+0000", 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.776727748000001, 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011063590999999999, 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908152+0000", 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.750 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908152+0000", 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908154+0000", 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5799999999999999e-06 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908203+0000", 2024-09-16T04:08:57.751 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.9786000000000001e-05 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908237+0000", 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3422e-05 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908307+0000", 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.0325000000000002e-05 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.752 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909572+0000", 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001264488 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909620+0000", 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8655000000000001e-05 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918931+0000", 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093103189999999992 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.753 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.919216+0000", 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028501600000000002 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:539 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908765+0000", 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.77611473, 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015950052999999999, 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.754 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 539 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908765+0000", 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908765+0000", 2024-09-16T04:08:57.755 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908768+0000", 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0960000000000001e-06 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908783+0000", 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.525e-05 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.756 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908818+0000", 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4476e-05 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908840+0000", 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2226e-05 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909124+0000", 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028427599999999997 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.757 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "op must wait for map", 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909137+0000", 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2442999999999999e-05 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914009+0000", 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048725189999999996 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914283+0000", 2024-09-16T04:08:57.758 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00027343000000000002 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.924715+0000", 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010432337 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:540 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:57.759 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908904+0000", 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.775975713999999, 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018391718000000001, 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 540 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.760 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908904+0000", 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908904+0000", 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908906+0000", 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6339999999999999e-06 2024-09-16T04:08:57.761 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908916+0000", 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9699999999999994e-06 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908939+0000", 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3811999999999998e-05 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908957+0000", 2024-09-16T04:08:57.762 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7235999999999999e-05 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909388+0000", 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00043154599999999999 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909415+0000", 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7109000000000001e-05 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.763 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.920093+0000", 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010677130999999999 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.920258+0000", 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016524199999999999 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.927296+0000", 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070380379999999999 2024-09-16T04:08:57.764 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:541 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908982+0000", 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.775897362, 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.026058347999999999, 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:08:57.765 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 541 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908982+0000", 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908982+0000", 2024-09-16T04:08:57.766 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908984+0000", 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3859999999999999e-06 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908994+0000", 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.8339999999999994e-06 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909013+0000", 2024-09-16T04:08:57.767 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9205e-05 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909026+0000", 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2984e-05 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909515+0000", 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00048913699999999995 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909533+0000", 2024-09-16T04:08:57.768 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7863000000000002e-05 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928869+0000", 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019336559999999999 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929225+0000", 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00035511100000000002 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.769 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.935041+0000", 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058162680000000003 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.771 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 64/31 ECSubWrite(tid=284, reqid=osd.11.0:284, at_version=64'30, trim_to=0'0, roll_forward_to=63'28))", 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.770004862, 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0097099319999999992, 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.772 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.6300000000000005e-07 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914947+0000", 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1338e-05 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.773 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914969+0000", 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2036e-05 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914994+0000", 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5343000000000001e-05 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.915143+0000", 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014897900000000001 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.774 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.915232+0000", 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8914999999999998e-05 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.924478+0000", 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092462369999999992 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.924585+0000", 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010652100000000001 2024-09-16T04:08:57.775 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 64/31 ECSubWrite(tid=270, reqid=osd.10.0:270, at_version=64'86, trim_to=0'0, roll_forward_to=63'84))", 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.918576+0000", 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.766303641, 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012891098, 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.776 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918576+0000", 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918576+0000", 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918578+0000", 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.777 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918654+0000", 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5581999999999996e-05 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918683+0000", 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9232999999999999e-05 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918705+0000", 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2376000000000001e-05 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.778 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918862+0000", 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015726600000000001 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918888+0000", 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5919e-05 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931379+0000", 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012490535000000001 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.779 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931467+0000", 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8337000000000005e-05 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 64/31 ECSubWrite(tid=271, reqid=osd.10.0:269, at_version=0'0, trim_to=0'0, roll_forward_to=64'142))", 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.921950+0000", 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.762929532999999, 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0097019189999999998, 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.780 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921950+0000", 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921950+0000", 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921952+0000", 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.973e-06 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.781 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921980+0000", 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7719e-05 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922369+0000", 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00038864699999999999 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922391+0000", 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2765999999999999e-05 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.782 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922542+0000", 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015051299999999999 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922568+0000", 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5698999999999999e-05 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931572+0000", 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090044779999999998 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.783 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931652+0000", 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0123999999999994e-05 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 74/69 ECSubWrite(tid=358, reqid=osd.10.0:358, at_version=74'41, trim_to=0'0, roll_forward_to=70'39))", 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 0.82060428799999996, 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010815933999999999, 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.784 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.785 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6299999999999993e-07 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864345+0000", 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8552000000000004e-05 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864377+0000", 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2193000000000002e-05 2024-09-16T04:08:57.786 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864399+0000", 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1766000000000001e-05 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.865105+0000", 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00070608499999999996 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.787 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.865130+0000", 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4669999999999999e-05 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.875033+0000", 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.009903607 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.875091+0000", 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8097999999999998e-05 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.788 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 74/31 ECSubWrite(tid=359, reqid=osd.10.0:359, at_version=74'173, trim_to=0'0, roll_forward_to=73'171))", 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:56.867151+0000", 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 0.817728805, 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093787420000000007, 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867151+0000", 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.789 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867151+0000", 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867153+0000", 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5400000000000001e-06 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867194+0000", 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1842999999999999e-05 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.790 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867215+0000", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0936000000000001e-05 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867229+0000", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3740000000000001e-05 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867307+0000", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8289999999999998e-05 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:08:57.791 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.867317+0000", 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.8060000000000006e-06 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.876441+0000", 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0091243090000000006 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.876530+0000", 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8277999999999997e-05 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.792 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.793 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:08:57.793 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:08:57.793 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:08:57.794 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:08:57.795 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:08:57.788+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:08:57.865 INFO:teuthology.orchestra.run.smithi032.stderr:set pool 3 pgp_num to 16 2024-09-16T04:08:57.869 INFO:tasks.rados.rados.0.smithi204.stdout:301: done (4 left) 2024-09-16T04:08:57.869 INFO:tasks.rados.rados.0.smithi204.stdout:302: snap_remove snap 18 2024-09-16T04:08:57.896 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:57.892+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:57.934 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:57.934 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:57.935 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:57.935 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:57.949 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:08:57.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:08:57.990+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:08:58.071 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:58.071 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:58.071 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:58.071 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:58.071 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:58.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:08:58.098 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:58.092+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:58.199 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:58.196+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:58.209 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.355860502999999, 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0070627650000000004, 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.210 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.211 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851455+0000", 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.206e-06 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851524+0000", 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8961999999999995e-05 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851547+0000", 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3893e-05 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851567+0000", 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9102000000000001e-05 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852770+0000", 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001203815 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852794+0000", 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3527e-05 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858409+0000", 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056155329999999998 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858516+0000", 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000106727 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:08:58.214 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.354763836, 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064106290000000002, 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:08:58.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852551+0000", 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6700000000000003e-07 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852640+0000", 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9158000000000003e-05 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852673+0000", 2024-09-16T04:08:58.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2775999999999999e-05 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852698+0000", 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5661999999999999e-05 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852915+0000", 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000216281 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.217 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853049+0000", 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013407299999999999 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858910+0000", 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005861163 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858961+0000", 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0949000000000003e-05 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.218 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=148, reqid=osd.10.0:147, at_version=0'0, trim_to=0'0, roll_forward_to=48'46))", 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.335941141999999, 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0071558660000000003, 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:08:58.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871375+0000", 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2929999999999999e-06 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871406+0000", 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1232999999999997e-05 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871444+0000", 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7688999999999998e-05 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871469+0000", 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4936e-05 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871646+0000", 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017657299999999999 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871673+0000", 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7044999999999999e-05 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878426+0000", 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067531659999999997 2024-09-16T04:08:58.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878529+0000", 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010293099999999999 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.334871879000001, 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0087467719999999999, 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.223 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.224 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872444+0000", 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4490000000000002e-06 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872725+0000", 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00028078400000000001 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872755+0000", 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9329999999999999e-05 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872775+0000", 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0750999999999998e-05 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872977+0000", 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020181499999999999 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873000+0000", 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3254000000000001e-05 2024-09-16T04:08:58.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881108+0000", 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0081072399999999999 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881189+0000", 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1149000000000005e-05 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=150, reqid=osd.10.0:150, at_version=48'48, trim_to=0'0, roll_forward_to=48'46))", 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.332251177, 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0059911859999999999, 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875065+0000", 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1399999999999998e-06 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875118+0000", 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3582000000000003e-05 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875151+0000", 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2311999999999998e-05 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875174+0000", 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.283e-05 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.230 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875376+0000", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020205700000000001 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875407+0000", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1792999999999999e-05 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880960+0000", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055526580000000002 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881054+0000", 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3814000000000007e-05 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 53/31 ECSubWrite(tid=244, reqid=client.4631.0:408, at_version=53'50, trim_to=0'0, roll_forward_to=52'48))", 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 22.324639142999999, 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0058951469999999999, 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.232 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882676+0000", 2024-09-16T04:08:58.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.093e-06 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883042+0000", 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00036582100000000001 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883079+0000", 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7622e-05 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883112+0000", 2024-09-16T04:08:58.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2685999999999998e-05 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883631+0000", 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00051925400000000003 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883755+0000", 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000124003 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.888484+0000", 2024-09-16T04:08:58.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047283309999999997 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.888570+0000", 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6336999999999997e-05 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 53/31 ECSubWrite(tid=179, reqid=client.4631.0:427, at_version=53'57, trim_to=0'0, roll_forward_to=52'55))", 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 22.049173660000001, 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060365560000000002, 2024-09-16T04:08:58.236 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.237 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158141+0000", 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5600000000000001e-07 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158605+0000", 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046468300000000002 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158631+0000", 2024-09-16T04:08:58.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.544e-05 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158655+0000", 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3699000000000001e-05 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158836+0000", 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018186299999999999 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158868+0000", 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1809e-05 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.164050+0000", 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051816689999999999 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.164177+0000", 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012693700000000001 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.240 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 21.139764928999998, 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053899769999999998, 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067550+0000", 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7999999999999995e-07 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067604+0000", 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4209000000000002e-05 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067647+0000", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2871999999999999e-05 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067671+0000", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4283000000000001e-05 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.068006+0000", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033519600000000001 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.068032+0000", 2024-09-16T04:08:58.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5303000000000002e-05 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072844+0000", 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048127869999999998 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072939+0000", 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4647000000000004e-05 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.244 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 54/31 ECSubWrite(tid=186, reqid=osd.10.0:186, at_version=54'62, trim_to=0'0, roll_forward_to=53'60))", 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 21.129447073000001, 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0057063770000000003, 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:58.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.04e-07 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077893+0000", 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6029000000000001e-05 2024-09-16T04:08:58.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077913+0000", 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9653999999999999e-05 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077941+0000", 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8561999999999999e-05 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.078109+0000", 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016742100000000001 2024-09-16T04:08:58.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.078136+0000", 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.711e-05 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.083476+0000", 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053401189999999999 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.083573+0000", 2024-09-16T04:08:58.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7277999999999999e-05 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 63/31 ECSubWrite(tid=243, reqid=client.4631.0:503, at_version=63'76, trim_to=0'0, roll_forward_to=62'74))", 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:45.899954+0000", 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 12.307359612000001, 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0059593249999999997, 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.249 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.899954+0000", 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.899954+0000", 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.899955+0000", 2024-09-16T04:08:58.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4000000000000001e-07 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900014+0000", 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.9412e-05 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900044+0000", 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0125999999999999e-05 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900075+0000", 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0346999999999999e-05 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900248+0000", 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000173449 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900276+0000", 2024-09-16T04:08:58.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7267000000000002e-05 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.905816+0000", 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055403659999999997 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.905914+0000", 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7718000000000002e-05 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 64/31 ECSubWrite(tid=290, reqid=client.4631.0:558, at_version=64'67, trim_to=0'0, roll_forward_to=64'66))", 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:47.019271+0000", 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.188042996, 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.007474957, 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019271+0000", 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.254 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019271+0000", 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019274+0000", 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8700000000000001e-06 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.255 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019325+0000", 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1409000000000002e-05 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019373+0000", 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7883000000000002e-05 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019399+0000", 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5469999999999998e-05 2024-09-16T04:08:58.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019803+0000", 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00040412199999999998 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019831+0000", 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8276000000000002e-05 2024-09-16T04:08:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.026666+0000", 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068353219999999996 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.026746+0000", 2024-09-16T04:08:58.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9604999999999994e-05 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 73/31 ECSubWrite(tid=91, reqid=client.4631.0:694, at_version=73'40, trim_to=0'0, roll_forward_to=73'38))", 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.068312+0000", 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.1390018510000002, 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0054766650000000004, 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068312+0000", 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068312+0000", 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.260 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068313+0000", 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.012e-06 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068513+0000", 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019977999999999999 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068554+0000", 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0812999999999997e-05 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068586+0000", 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2563e-05 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068778+0000", 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000192213 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068819+0000", 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0349000000000003e-05 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.073694+0000", 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004875117 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.073789+0000", 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4817999999999999e-05 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.263 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 73/31 ECSubWrite(tid=92, reqid=client.4631.0:695, at_version=73'41, trim_to=0'0, roll_forward_to=73'38))", 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.069858+0000", 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.137455696, 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093874839999999998, 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.264 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069858+0000", 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069858+0000", 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069860+0000", 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.372e-06 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069947+0000", 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7717000000000001e-05 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069966+0000", 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9080999999999999e-05 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069979+0000", 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2539e-05 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.266 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.070099+0000", 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000119836 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.070122+0000", 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3105999999999999e-05 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.079160+0000", 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.009038305 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.267 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.079246+0000", 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5527999999999998e-05 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 73/31 ECSubWrite(tid=93, reqid=client.4631.0:696, at_version=73'42, trim_to=0'0, roll_forward_to=73'39))", 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.071521+0000", 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.1357924530000001, 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0096354549999999994, 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071521+0000", 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071521+0000", 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071523+0000", 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.099e-06 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071545+0000", 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2583999999999999e-05 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071562+0000", 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7136e-05 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071572+0000", 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2289999999999992e-06 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071666+0000", 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4326000000000005e-05 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071683+0000", 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7275999999999999e-05 2024-09-16T04:08:58.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.079254+0000", 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.007570495 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.081157+0000", 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019033100000000001 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.272 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 73/31 ECSubWrite(tid=307, reqid=client.4631.0:718, at_version=73'75, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.172216+0000", 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.0350978660000001, 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.008843254, 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.273 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172216+0000", 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172216+0000", 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172219+0000", 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5129999999999999e-06 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.274 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172276+0000", 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7283e-05 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172326+0000", 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0565999999999997e-05 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172351+0000", 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4975999999999999e-05 2024-09-16T04:08:58.275 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172553+0000", 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020191999999999999 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172580+0000", 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6466999999999999e-05 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.276 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180980+0000", 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0083997399999999993 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181059+0000", 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9789000000000005e-05 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 73/31 ECSubWrite(tid=308, reqid=client.4631.0:719, at_version=73'76, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:08:58.277 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176323+0000", 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.0309906999999998, 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0066864940000000003, 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176323+0000", 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.278 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176323+0000", 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176326+0000", 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7499999999999999e-06 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176378+0000", 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1928999999999997e-05 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176415+0000", 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7106e-05 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176440+0000", 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4649999999999999e-05 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176592+0000", 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015200700000000001 2024-09-16T04:08:58.280 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176616+0000", 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4700000000000001e-05 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.182911+0000", 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0062944869999999997 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.183010+0000", 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8864999999999996e-05 2024-09-16T04:08:58.281 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 73/31 ECSubWrite(tid=309, reqid=client.4631.0:720, at_version=73'77, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176739+0000", 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.030574664, 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0070976980000000004, 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.282 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176739+0000", 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176739+0000", 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176742+0000", 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:08:58.283 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176917+0000", 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017562099999999999 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176954+0000", 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6709999999999999e-05 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176980+0000", 2024-09-16T04:08:58.284 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6132e-05 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180598+0000", 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036179099999999998 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180621+0000", 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3393000000000001e-05 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.183766+0000", 2024-09-16T04:08:58.285 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031449210000000002 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.183837+0000", 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.0641000000000003e-05 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 74/31 ECSubWrite(tid=105, reqid=osd.12.0:105, at_version=74'45, trim_to=0'0, roll_forward_to=73'43))", 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:08:58.286 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 1.34285426, 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061017770000000001, 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.287 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7999999999999995e-07 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864519+0000", 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.9154999999999999e-05 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.288 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864552+0000", 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2977e-05 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864578+0000", 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5395999999999999e-05 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864755+0000", 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017691699999999999 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864781+0000", 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5836000000000001e-05 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.870475+0000", 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056942269999999996 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.870561+0000", 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6588999999999994e-05 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.290 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 74/31 ECSubWrite(tid=361, reqid=osd.10.0:361, at_version=74'104, trim_to=0'0, roll_forward_to=73'102))", 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.877773+0000", 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 1.3295407299999999, 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0052666040000000003, 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.877773+0000", 2024-09-16T04:08:58.291 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.877773+0000", 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.877774+0000", 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4200000000000001e-07 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.292 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.877812+0000", 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8420000000000001e-05 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.877837+0000", 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4610999999999999e-05 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.877852+0000", 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5807999999999998e-05 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.293 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.878006+0000", 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015379200000000001 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.878035+0000", 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8666e-05 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.882942+0000", 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049074959999999999 2024-09-16T04:08:58.294 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.883040+0000", 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7368999999999996e-05 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 75/31 ECSubWrite(tid=380, reqid=osd.10.0:380, at_version=75'119, trim_to=0'0, roll_forward_to=75'117))", 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.891080+0000", 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 0.31623383100000002, 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053283669999999997, 2024-09-16T04:08:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891080+0000", 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891080+0000", 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.296 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891081+0000", 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2900000000000003e-07 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891106+0000", 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4851e-05 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891118+0000", 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2527999999999999e-05 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.297 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891127+0000", 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0569999999999999e-06 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891265+0000", 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000137513 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.891294+0000", 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8909000000000001e-05 2024-09-16T04:08:58.298 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.896334+0000", 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050400779999999999 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.896408+0000", 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4702000000000004e-05 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.299 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:58.301 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:08:58.302 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:58.296+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:58.403 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:58.399+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:58.428 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:58.428 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:58.428 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:08:58.428 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:58.442 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:08:58.504 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:58.501+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:58.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:08:58.606 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:58.605+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:58.612 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:58.613 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:08:58.613 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:08:58.613 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:08:58.613 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:58.627 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:08:58.704 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:58.701+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:58.720 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:08:58.720 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:08:58.741 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:08:58.741 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:08:58.750 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 33/31 ECSubWrite(tid=4, reqid=client.4631.0:19, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.805239032999999, 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046610189999999998, 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.751 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941328+0000", 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941329+0000", 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0720000000000001e-06 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941664+0000", 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033524 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941685+0000", 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0548999999999999e-05 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941695+0000", 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0696999999999999e-05 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942769+0000", 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010735 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.942777+0000", 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4950000000000008e-06 2024-09-16T04:08:58.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945953+0000", 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031750350000000001 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.945989+0000", 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6430999999999997e-05 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=162, reqid=client.4631.0:37, at_version=34'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.797848758999997, 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005624703, 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.756 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.757 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7399999999999999e-07 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948775+0000", 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6127e-05 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.758 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948794+0000", 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9264000000000001e-05 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948804+0000", 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7499999999999998e-06 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.759 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949606+0000", 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080285899999999995 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949616+0000", 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6900000000000004e-06 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954283+0000", 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046664230000000003 2024-09-16T04:08:58.760 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954343+0000", 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0316000000000003e-05 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=163, reqid=client.4631.0:38, at_version=34'4, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.796706632999999, 2024-09-16T04:08:58.761 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045180239999999998, 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949860+0000", 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.762 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949861+0000", 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1149999999999999e-06 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949901+0000", 2024-09-16T04:08:58.763 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9934000000000001e-05 2024-09-16T04:08:58.764 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.764 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.764 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.764 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949919+0000", 2024-09-16T04:08:58.764 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7291000000000001e-05 2024-09-16T04:08:58.764 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.765 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.765 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.765 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949932+0000", 2024-09-16T04:08:58.765 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3383e-05 2024-09-16T04:08:58.765 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.765 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950027+0000", 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4493000000000005e-05 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.766 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950035+0000", 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2689999999999999e-06 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954354+0000", 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0043187429999999999 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.767 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954378+0000", 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4796000000000001e-05 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.768 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.769 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:08:58.769 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:58.769 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 32.713815930999999, 2024-09-16T04:08:58.769 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049720880000000004, 2024-09-16T04:08:58.769 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.769 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.770 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.770 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.770 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.770 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.770 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:58.770 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.771 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.771 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.771 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.771 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:58.771 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.771 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3900000000000001e-07 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032842+0000", 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0807e-05 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.772 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032862+0000", 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9660000000000002e-05 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032872+0000", 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0726e-05 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032974+0000", 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101142 2024-09-16T04:08:58.773 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032984+0000", 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0713000000000001e-05 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037679+0000", 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046946610000000001 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037723+0000", 2024-09-16T04:08:58.774 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4140000000000001e-05 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 31.716940135000002, 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047342010000000004, 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.775 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029627+0000", 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5700000000000002e-07 2024-09-16T04:08:58.776 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029691+0000", 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3400999999999998e-05 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029741+0000", 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9975000000000002e-05 2024-09-16T04:08:58.777 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029761+0000", 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0356999999999998e-05 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.030019+0000", 2024-09-16T04:08:58.778 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00025759600000000002 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.030043+0000", 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4301999999999999e-05 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034280+0000", 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004236638 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.779 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034361+0000", 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1274999999999997e-05 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851343+0000", 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.895223864999998, 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045365689999999998, 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.780 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851343+0000", 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851343+0000", 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.781 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851344+0000", 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7199999999999999e-07 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851382+0000", 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8405999999999998e-05 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851404+0000", 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1878999999999998e-05 2024-09-16T04:08:58.782 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851423+0000", 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9332999999999999e-05 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851586+0000", 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016265299999999999 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.783 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851613+0000", 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6709000000000001e-05 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855819+0000", 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042065119999999999 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855880+0000", 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0504999999999998e-05 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.784 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.895104412999999, 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055937950000000004, 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:08:58.786 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0999999999999999e-07 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851488+0000", 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4587e-05 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851502+0000", 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4797000000000001e-05 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.787 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851514+0000", 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1073000000000001e-05 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853720+0000", 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00220616 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853745+0000", 2024-09-16T04:08:58.788 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5653e-05 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857009+0000", 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003263775 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.789 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857056+0000", 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7240000000000002e-05 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.894446493, 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051176499999999996, 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.790 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.791 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852121+0000", 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7599999999999996e-07 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852170+0000", 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9035000000000001e-05 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852191+0000", 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0472999999999999e-05 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.792 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852205+0000", 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4048e-05 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852390+0000", 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018541099999999999 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852418+0000", 2024-09-16T04:08:58.793 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7985999999999999e-05 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857089+0000", 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046703320000000001 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857238+0000", 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014958899999999999 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.794 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.894315018, 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050972430000000004, 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852253+0000", 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1099999999999995e-07 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852285+0000", 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1846e-05 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.796 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852299+0000", 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4659e-05 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852310+0000", 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1287999999999999e-05 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.797 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853693+0000", 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001382826 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853719+0000", 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6016e-05 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857307+0000", 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003587369 2024-09-16T04:08:58.798 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857349+0000", 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2527999999999997e-05 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.799 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=226, reqid=client.4631.0:375, at_version=48'39, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.884287987, 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050701030000000003, 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.800 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862280+0000", 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2389999999999999e-06 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862380+0000", 2024-09-16T04:08:58.801 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9331000000000002e-05 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862396+0000", 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6789000000000001e-05 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.802 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.803 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862409+0000", 2024-09-16T04:08:58.804 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2384e-05 2024-09-16T04:08:58.804 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.804 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.804 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.804 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862627+0000", 2024-09-16T04:08:58.804 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021813 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862652+0000", 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5519000000000001e-05 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.805 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867248+0000", 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045958509999999998 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867349+0000", 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010086000000000001 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.806 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.873924842000001, 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0069465819999999998, 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.807 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872645+0000", 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.384e-06 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.808 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872912+0000", 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00026752299999999998 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872958+0000", 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5624999999999998e-05 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872982+0000", 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4443e-05 2024-09-16T04:08:58.809 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873128+0000", 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014554100000000001 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873152+0000", 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4428000000000001e-05 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879494+0000", 2024-09-16T04:08:58.810 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0063421629999999996 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879589+0000", 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4475000000000006e-05 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=246, reqid=client.4631.0:409, at_version=53'51, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 22.853288754000001, 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0085214520000000005, 2024-09-16T04:08:58.811 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.812 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893281+0000", 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4099999999999998e-06 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893613+0000", 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033196199999999999 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.813 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893658+0000", 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5498999999999999e-05 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893682+0000", 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4159e-05 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893893+0000", 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000210845 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.814 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.815 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893920+0000", 2024-09-16T04:08:58.815 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6931999999999999e-05 2024-09-16T04:08:58.815 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.815 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.815 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901667+0000", 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0077466979999999998 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901800+0000", 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013294700000000001 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.816 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=247, reqid=client.4631.0:410, at_version=53'52, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 22.849633537999999, 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004935488, 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:08:58.817 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896935+0000", 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8959999999999999e-06 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.818 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897016+0000", 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0438000000000005e-05 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897061+0000", 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4988999999999999e-05 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897084+0000", 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3139999999999999e-05 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.819 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897310+0000", 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000226424 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897334+0000", 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4083e-05 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901810+0000", 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0044760260000000001 2024-09-16T04:08:58.820 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901869+0000", 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8492000000000002e-05 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 21.679075813000001, 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053273050000000001, 2024-09-16T04:08:58.821 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.822 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067492+0000", 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0299999999999998e-07 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067551+0000", 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8916000000000003e-05 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067582+0000", 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1472e-05 2024-09-16T04:08:58.823 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067606+0000", 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3485999999999998e-05 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000125365 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067741+0000", 2024-09-16T04:08:58.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9890000000000004e-06 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072715+0000", 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049738159999999998 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072818+0000", 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103458 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.825 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/31 ECSubWrite(tid=111, reqid=osd.13.0:111, at_version=60'33, trim_to=0'0, roll_forward_to=59'31))", 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:42.885882+0000", 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 15.860684871, 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048794600000000004, 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.885882+0000", 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.826 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.885882+0000", 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.885883+0000", 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1400000000000001e-06 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.827 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.885921+0000", 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7554e-05 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.885939+0000", 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8536e-05 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.885951+0000", 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1483e-05 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.828 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.886028+0000", 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7154e-05 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.886041+0000", 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3524e-05 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.890715+0000", 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004673923 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.829 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:42.890762+0000", 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6146000000000002e-05 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=307, reqid=client.4631.0:718, at_version=73'75, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.574452526, 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060468179999999998, 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.830 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.831 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172117+0000", 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1330000000000002e-06 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172170+0000", 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3256e-05 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172211+0000", 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1554999999999998e-05 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.832 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172236+0000", 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4980000000000001e-05 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172713+0000", 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00047679299999999999 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172743+0000", 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0229000000000001e-05 2024-09-16T04:08:58.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.178058+0000", 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053146169999999998 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.178161+0000", 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103255 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=308, reqid=client.4631.0:719, at_version=73'76, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.5717198730000002, 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005380162, 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.835 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174850+0000", 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8100000000000002e-06 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174903+0000", 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2908999999999998e-05 2024-09-16T04:08:58.836 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174935+0000", 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2660000000000002e-05 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174956+0000", 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0109e-05 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.175187+0000", 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00023095 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.175210+0000", 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3736000000000001e-05 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180131+0000", 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049211790000000004 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180227+0000", 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5809000000000004e-05 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=309, reqid=client.4631.0:720, at_version=73'77, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 2.5697735069999998, 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048893319999999997, 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.839 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176795+0000", 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9230000000000001e-06 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176840+0000", 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4722999999999999e-05 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176874+0000", 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3835999999999999e-05 2024-09-16T04:08:58.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176897+0000", 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2799999999999999e-05 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.177457+0000", 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00056058499999999995 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.177481+0000", 2024-09-16T04:08:58.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4006e-05 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181605+0000", 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0041238280000000004 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181683+0000", 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7631000000000003e-05 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.843 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 74/31 ECSubWrite(tid=184, reqid=osd.13.0:183, at_version=0'0, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.867046+0000", 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 1.879521357, 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046609570000000003, 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867046+0000", 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.844 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867046+0000", 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867048+0000", 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0140000000000001e-06 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867078+0000", 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0806000000000003e-05 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867201+0000", 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012299500000000001 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867260+0000", 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8995e-05 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867424+0000", 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000163461 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867449+0000", 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4776000000000001e-05 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.871610+0000", 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0041609280000000004 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.871707+0000", 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6982000000000001e-05 2024-09-16T04:08:58.847 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 74/31 ECSubWrite(tid=187, reqid=client.4631.0:758, at_version=74'47, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 1.7210441649999999, 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061683500000000004, 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:08:58.848 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025524+0000", 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.587e-06 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.849 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026540+0000", 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001015324 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026570+0000", 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0642999999999998e-05 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026586+0000", 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6118999999999999e-05 2024-09-16T04:08:58.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026721+0000", 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013497499999999999 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026737+0000", 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5763000000000001e-05 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.031644+0000", 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049069880000000001 2024-09-16T04:08:58.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.031691+0000", 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6950999999999998e-05 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:08:58.852 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:08:58.853 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:08:58.854 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:08:58.854 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:08:58.855 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:08:58.855 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:08:58.855 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:08:58.856 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:08:58.856 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:08:58.856 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:08:58.857 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:08:58.857 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:08:58.857 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:58.848+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:58.873 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:08:58.874 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:08:58.875 INFO:tasks.rados.rados.0.smithi204.stdout:302: done (4 left) 2024-09-16T04:08:58.875 INFO:tasks.rados.rados.0.smithi204.stdout:303: snap_remove snap 19 2024-09-16T04:08:58.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-16T04:08:58.899 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:08:58.899 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:08:58.929 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:08:58.930 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:08:58.951 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:08:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:08:58.955 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:58.950+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:58.972 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:08:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:08:58.990 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:08:58.990 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:08:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.009 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:08:59.011 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:08:59.011 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:08:59.034 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:08:59.034 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:08:59.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:08:59.049+0000 7f8b137fe640 0 -- 172.21.15.32:0/2197804916 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7f8b142243d0 msgr2=0x7f8b142267c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:08:59.056 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:08:59.094 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:08:59.091+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:08:59.156 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:59.156+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:59.170 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:59.170 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:08:59.257 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:59.250+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:59.350 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:59.350 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.357 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:08:59.351+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:08:59.364 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:08:59.459 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:08:59.457+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:08:59.532 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:59.532 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.547 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:08:59.560 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:08:59.555+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:08:59.660 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:08:59.657+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:08:59.666 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:59.666 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.680 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:08:59.762 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:08:59.758+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:08:59.797 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:59.798 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:08:59.847 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-16T04:08:59.853 INFO:tasks.rados.rados.0.smithi204.stdout:303: done (4 left) 2024-09-16T04:08:59.853 INFO:tasks.rados.rados.0.smithi204.stdout:304: read oid 32 snap -1 2024-09-16T04:08:59.853 INFO:tasks.rados.rados.0.smithi204.stdout:304: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:59.854 INFO:tasks.rados.rados.0.smithi204.stdout:305: read oid 46 snap 21 2024-09-16T04:08:59.854 INFO:tasks.rados.rados.0.smithi204.stdout:305: expect (ObjNum 1075979328 snap 21886 seq_num 1076283632) 2024-09-16T04:08:59.854 INFO:tasks.rados.rados.0.smithi204.stdout:306: delete oid 29 current snap is 22 2024-09-16T04:08:59.854 INFO:tasks.rados.rados.0.smithi204.stdout:297: finishing write tid 2 to smithi20431790-12 2024-09-16T04:08:59.854 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 50 v 113 (ObjNum 89 snap 11 seq_num 89) dirty exists 2024-09-16T04:08:59.854 INFO:tasks.rados.rados.0.smithi204.stdout:297: finishing write tid 3 to smithi20431790-12 2024-09-16T04:08:59.855 INFO:tasks.rados.rados.0.smithi204.stdout:297: finishing write tid 4 to smithi20431790-12 2024-09-16T04:08:59.855 INFO:tasks.rados.rados.0.smithi204.stdout:297: finishing write tid 5 to smithi20431790-12 2024-09-16T04:08:59.855 INFO:tasks.rados.rados.0.smithi204.stdout:297: finishing write tid 6 to smithi20431790-12 2024-09-16T04:08:59.855 INFO:tasks.rados.rados.0.smithi204.stdout:297: oid 12 updating version 0 to 64 2024-09-16T04:08:59.855 INFO:tasks.rados.rados.0.smithi204.stdout:297: oid 12 version 64 is already newer than 61 2024-09-16T04:08:59.855 INFO:tasks.rados.rados.0.smithi204.stdout:297: oid 12 version 64 is already newer than 62 2024-09-16T04:08:59.856 INFO:tasks.rados.rados.0.smithi204.stdout:297: oid 12 version 64 is already newer than 63 2024-09-16T04:08:59.856 INFO:tasks.rados.rados.0.smithi204.stdout:297: oid 12 updating version 64 to 65 2024-09-16T04:08:59.856 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 12 v 65 (ObjNum 127 snap 22 seq_num 127) dirty exists 2024-09-16T04:08:59.856 INFO:tasks.rados.rados.0.smithi204.stdout:297: left oid 12 (ObjNum 127 snap 22 seq_num 127) 2024-09-16T04:08:59.856 INFO:tasks.rados.rados.0.smithi204.stdout:299: finishing write tid 1 to smithi20431790-6 2024-09-16T04:08:59.856 INFO:tasks.rados.rados.0.smithi204.stdout:299: finishing write tid 2 to smithi20431790-6 2024-09-16T04:08:59.857 INFO:tasks.rados.rados.0.smithi204.stdout:299: finishing write tid 3 to smithi20431790-6 2024-09-16T04:08:59.857 INFO:tasks.rados.rados.0.smithi204.stdout:299: finishing write tid 4 to smithi20431790-6 2024-09-16T04:08:59.857 INFO:tasks.rados.rados.0.smithi204.stdout:299: finishing write tid 5 to smithi20431790-6 2024-09-16T04:08:59.857 INFO:tasks.rados.rados.0.smithi204.stdout:299: finishing write tid 6 to smithi20431790-6 2024-09-16T04:08:59.857 INFO:tasks.rados.rados.0.smithi204.stdout:299: oid 6 updating version 0 to 103 2024-09-16T04:08:59.857 INFO:tasks.rados.rados.0.smithi204.stdout:299: oid 6 updating version 103 to 104 2024-09-16T04:08:59.858 INFO:tasks.rados.rados.0.smithi204.stdout:299: oid 6 version 104 is already newer than 101 2024-09-16T04:08:59.858 INFO:tasks.rados.rados.0.smithi204.stdout:299: oid 6 version 104 is already newer than 102 2024-09-16T04:08:59.858 INFO:tasks.rados.rados.0.smithi204.stdout:299: oid 6 updating version 104 to 105 2024-09-16T04:08:59.858 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 6 v 105 (ObjNum 128 snap 22 seq_num 128) dirty exists 2024-09-16T04:08:59.858 INFO:tasks.rados.rados.0.smithi204.stdout:299: left oid 6 (ObjNum 128 snap 22 seq_num 128) 2024-09-16T04:08:59.858 INFO:tasks.rados.rados.0.smithi204.stdout:300: finishing write tid 1 to smithi20431790-47 2024-09-16T04:08:59.859 INFO:tasks.rados.rados.0.smithi204.stdout:300: finishing write tid 2 to smithi20431790-47 2024-09-16T04:08:59.859 INFO:tasks.rados.rados.0.smithi204.stdout:300: finishing write tid 3 to smithi20431790-47 2024-09-16T04:08:59.859 INFO:tasks.rados.rados.0.smithi204.stdout:300: finishing write tid 4 to smithi20431790-47 2024-09-16T04:08:59.859 INFO:tasks.rados.rados.0.smithi204.stdout:300: finishing write tid 5 to smithi20431790-47 2024-09-16T04:08:59.859 INFO:tasks.rados.rados.0.smithi204.stdout:300: finishing write tid 6 to smithi20431790-47 2024-09-16T04:08:59.859 INFO:tasks.rados.rados.0.smithi204.stdout:300: oid 47 updating version 0 to 55 2024-09-16T04:08:59.860 INFO:tasks.rados.rados.0.smithi204.stdout:300: oid 47 version 55 is already newer than 54 2024-09-16T04:08:59.860 INFO:tasks.rados.rados.0.smithi204.stdout:300: oid 47 version 55 is already newer than 53 2024-09-16T04:08:59.860 INFO:tasks.rados.rados.0.smithi204.stdout:300: oid 47 updating version 55 to 56 2024-09-16T04:08:59.860 INFO:tasks.rados.rados.0.smithi204.stdout:300: oid 47 updating version 56 to 57 2024-09-16T04:08:59.860 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 47 v 57 (ObjNum 129 snap 22 seq_num 129) dirty exists 2024-09-16T04:08:59.860 INFO:tasks.rados.rados.0.smithi204.stdout:300: left oid 47 (ObjNum 129 snap 22 seq_num 129) 2024-09-16T04:08:59.861 INFO:tasks.rados.rados.0.smithi204.stdout:305: expect (ObjNum 1075979328 snap 21886 seq_num 1076283632) 2024-09-16T04:08:59.868 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:08:59.859+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:08:59.870 INFO:tasks.rados.rados.0.smithi204.stdout:304: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:08:59.904 INFO:tasks.rados.rados.0.smithi204.stdout:297: done (6 left) 2024-09-16T04:08:59.904 INFO:tasks.rados.rados.0.smithi204.stdout:298: done (5 left) 2024-09-16T04:08:59.904 INFO:tasks.rados.rados.0.smithi204.stdout:299: done (4 left) 2024-09-16T04:08:59.904 INFO:tasks.rados.rados.0.smithi204.stdout:300: done (3 left) 2024-09-16T04:08:59.904 INFO:tasks.rados.rados.0.smithi204.stdout:304: done (2 left) 2024-09-16T04:08:59.904 INFO:tasks.rados.rados.0.smithi204.stdout:305: done (1 left) 2024-09-16T04:08:59.905 INFO:tasks.rados.rados.0.smithi204.stdout:306: done (0 left) 2024-09-16T04:08:59.905 INFO:tasks.rados.rados.0.smithi204.stdout:307: snap_create 2024-09-16T04:08:59.961 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:08:59.961 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:08:59.964 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:08:59.958+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:08:59.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:09:00.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:09:00.058+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:09:00.101 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.101 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:09:00.165 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:00.159+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:00.250 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.251 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:09:00.267 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:00.263+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:00.368 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:00.363+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:00.392 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.392 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:09:00.468 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:00.462+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:00.534 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.534 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:09:00.569 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:00.562+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:00.670 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:00.670+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:00.676 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.676 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:09:00.772 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:00.766+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:00.820 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.820 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:09:00.873 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:09:00.867+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:09:00.886 INFO:tasks.rados.rados.0.smithi204.stdout:307: done (0 left) 2024-09-16T04:09:00.886 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 38 current snap is 23 2024-09-16T04:09:00.886 INFO:tasks.rados.rados.0.smithi204.stdout:308: seq_num 131 ranges {622592=655360,1277952=425984,1703936=638976,2342912=491520} 2024-09-16T04:09:00.905 INFO:tasks.rados.rados.0.smithi204.stdout:308: writing smithi20431790-38 from 622592 to 1277952 tid 1 2024-09-16T04:09:00.912 INFO:tasks.rados.rados.0.smithi204.stdout:308: writing smithi20431790-38 from 1277952 to 1703936 tid 2 2024-09-16T04:09:00.921 INFO:tasks.rados.rados.0.smithi204.stdout:308: writing smithi20431790-38 from 1703936 to 2342912 tid 3 2024-09-16T04:09:00.929 INFO:tasks.rados.rados.0.smithi204.stdout:308: writing smithi20431790-38 from 2342912 to 2834432 tid 4 2024-09-16T04:09:00.929 INFO:tasks.rados.rados.0.smithi204.stdout:309: read oid 16 snap -1 2024-09-16T04:09:00.929 INFO:tasks.rados.rados.0.smithi204.stdout:309: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:00.929 INFO:tasks.rados.rados.0.smithi204.stdout:310: delete oid 20 current snap is 23 2024-09-16T04:09:00.929 INFO:tasks.rados.rados.0.smithi204.stdout:308: finishing write tid 1 to smithi20431790-38 2024-09-16T04:09:00.929 INFO:tasks.rados.rados.0.smithi204.stdout:308: finishing write tid 2 to smithi20431790-38 2024-09-16T04:09:00.930 INFO:tasks.rados.rados.0.smithi204.stdout:308: finishing write tid 3 to smithi20431790-38 2024-09-16T04:09:00.938 INFO:tasks.rados.rados.0.smithi204.stdout:309: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:00.951 INFO:tasks.rados.rados.0.smithi204.stdout:308: finishing write tid 4 to smithi20431790-38 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: finishing write tid 5 to smithi20431790-38 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: finishing write tid 6 to smithi20431790-38 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: oid 38 updating version 0 to 41 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: oid 38 updating version 41 to 42 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: oid 38 version 42 is already newer than 40 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: oid 38 updating version 42 to 44 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: oid 38 version 44 is already newer than 43 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 38 v 44 (ObjNum 131 snap 23 seq_num 131) dirty exists 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: left oid 38 (ObjNum 131 snap 23 seq_num 131) 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:308: done (2 left) 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:309: done (1 left) 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:310: done (0 left) 2024-09-16T04:09:00.952 INFO:tasks.rados.rados.0.smithi204.stdout:311: read oid 31 snap -1 2024-09-16T04:09:00.953 INFO:tasks.rados.rados.0.smithi204.stdout:311: expect deleted 2024-09-16T04:09:00.953 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 15 current snap is 23 2024-09-16T04:09:00.953 INFO:tasks.rados.rados.0.smithi204.stdout:312: seq_num 133 ranges {2834432=688128,3522560=720896,4243456=475136,4718592=360448} 2024-09-16T04:09:00.958 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:00.958 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:00.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:09:00.974 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:00.966+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:01.002 INFO:tasks.rados.rados.0.smithi204.stdout:312: writing smithi20431790-15 from 2834432 to 3522560 tid 1 2024-09-16T04:09:01.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: writing smithi20431790-15 from 3522560 to 4243456 tid 2 2024-09-16T04:09:01.014 INFO:tasks.rados.rados.0.smithi204.stdout:312: writing smithi20431790-15 from 4243456 to 4718592 tid 3 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:312: writing smithi20431790-15 from 4718592 to 5079040 tid 4 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:313: read oid 48 snap -1 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:313: expect (ObjNum 113 snap 19 seq_num 113) 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:314: read oid 28 snap -1 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:314: expect (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:315: read oid 11 snap 21 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:315: expect deleted 2024-09-16T04:09:01.018 INFO:tasks.rados.rados.0.smithi204.stdout:316: delete oid 32 current snap is 23 2024-09-16T04:09:01.019 INFO:tasks.rados.rados.0.smithi204.stdout:312: finishing write tid 1 to smithi20431790-15 2024-09-16T04:09:01.027 INFO:tasks.rados.rados.0.smithi204.stdout:312: finishing write tid 2 to smithi20431790-15 2024-09-16T04:09:01.028 INFO:tasks.rados.rados.0.smithi204.stdout:311: done (5 left) 2024-09-16T04:09:01.028 INFO:tasks.rados.rados.0.smithi204.stdout:315: done (4 left) 2024-09-16T04:09:01.028 INFO:tasks.rados.rados.0.smithi204.stdout:316: done (3 left) 2024-09-16T04:09:01.028 INFO:tasks.rados.rados.0.smithi204.stdout:317: copy_from oid 10 from oid 31 current snap is 23 2024-09-16T04:09:01.028 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 13 current snap is 23 2024-09-16T04:09:01.029 INFO:tasks.rados.rados.0.smithi204.stdout:318: seq_num 135 ranges {1409024=720896,2129920=622592,2752512=688128,3440640=245760} 2024-09-16T04:09:01.047 INFO:tasks.rados.rados.0.smithi204.stdout:318: writing smithi20431790-13 from 1409024 to 2129920 tid 1 2024-09-16T04:09:01.052 INFO:tasks.rados.rados.0.smithi204.stdout:318: writing smithi20431790-13 from 2129920 to 2752512 tid 2 2024-09-16T04:09:01.058 INFO:tasks.rados.rados.0.smithi204.stdout:318: writing smithi20431790-13 from 2752512 to 3440640 tid 3 2024-09-16T04:09:01.060 INFO:tasks.rados.rados.0.smithi204.stdout:318: writing smithi20431790-13 from 3440640 to 3686400 tid 4 2024-09-16T04:09:01.060 INFO:tasks.rados.rados.0.smithi204.stdout:319: rollback oid 27 current snap is 23 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:312: finishing write tid 3 to smithi20431790-15 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 27 to 22 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:312: finishing write tid 4 to smithi20431790-15 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:317: finishing copy_from to smithi20431790-10 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:317: got expected ENOENT (src dne) 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:317: finishing copy_from racing read to smithi20431790-10 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:317: done (5 left) 2024-09-16T04:09:01.061 INFO:tasks.rados.rados.0.smithi204.stdout:320: snap_remove snap 21 2024-09-16T04:09:01.074 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:09:01.067+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:09:01.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:09:01.098 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:01.098 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:01.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:09:01.202 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:09:01.201+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:09:01.239 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:09:01.239 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:09:01.260 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:09:01.260 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:09:01.276 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:01.271+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:01.281 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:09:01.282 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:09:01.294 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:01.294 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:01.302 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:09:01.303 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:09:01.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:09:01.322 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:09:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:09:01.345 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:09:01.345 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:09:01.368 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:09:01.368 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:09:01.375 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:01.373+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:01.391 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:09:01.391 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:09:01.411 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:09:01.412 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:09:01.434 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:09:01.434 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:09:01.450 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:01.450 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:01.456 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:09:01.456 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:09:01.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:09:01.480 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:09:01.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:09:01.481 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:09:01.477+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:09:01.500 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:09:01.501 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:09:01.524 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:09:01.525 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:09:01.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:09:01.525+0000 7f33a509c640 0 -- 172.21.15.32:0/290654064 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7f33a0221670 msgr2=0x7f33a0223a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:09:01.550 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:09:01.551 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:09:01.571 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:09:01.572 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:09:01.577 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:09:01.573+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:31 3.9s0 3:93634e21:::smithi20431790-11:head [append 0~180224,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.660196356999997, 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015779225000000001, 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.611 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 31 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947688+0000", 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.599e-06 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948028+0000", 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000340491 2024-09-16T04:09:01.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948040+0000", 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1488000000000001e-05 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948046+0000", 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948165+0000", 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011934000000000001 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948369+0000", 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020333999999999999 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949522+0000", 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001153435 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951355+0000", 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001833386 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963404+0000", 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012048644000000001 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963464+0000", 2024-09-16T04:09:01.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0044999999999999e-05 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:32 3.9s0 3:93634e21:::smithi20431790-11:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.659813665999998, 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015702510999999999, 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.617 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 32 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2600000000000002e-07 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948073+0000", 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6700000000000002e-06 2024-09-16T04:09:01.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948082+0000", 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-06 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948090+0000", 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9729999999999997e-06 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950170+0000", 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020803670000000001 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950297+0000", 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127062 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950926+0000", 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062826500000000003 2024-09-16T04:09:01.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951904+0000", 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000978694 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963618+0000", 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011714096 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963770+0000", 2024-09-16T04:09:01.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015180799999999999 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:33 3.9s0 3:93634e21:::smithi20431790-11:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.659757732999999, 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018249636999999999, 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 33 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948125+0000", 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.159e-06 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948130+0000", 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5559999999999998e-06 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948145+0000", 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5057e-05 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948155+0000", 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7040000000000006e-06 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951232+0000", 2024-09-16T04:09:01.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077069 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951336+0000", 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103558 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964171+0000", 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012834887999999999 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964283+0000", 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112611 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966373+0000", 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020900350000000001 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:99 3.0s0 3:0daec8ce:::smithi20431790-33:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.592454502999999, 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008043718, 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 99 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015427+0000", 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0299999999999999e-07 2024-09-16T04:09:01.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015431+0000", 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9940000000000002e-06 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015441+0000", 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.015448+0000", 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018104+0000", 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026563300000000001 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.018194+0000", 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9544999999999997e-05 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.021888+0000", 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036945709999999998 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.022023+0000", 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013508899999999999 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.023471+0000", 2024-09-16T04:09:01.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001447343 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:109 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~606208,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.577597971000003, 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069726889999999998, 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 109 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030283+0000", 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030285+0000", 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8330000000000001e-06 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.030998+0000", 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071285399999999996 2024-09-16T04:09:01.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031011+0000", 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2935000000000001e-05 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031017+0000", 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031073+0000", 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6746999999999997e-05 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031204+0000", 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013035600000000001 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.032021+0000", 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081749100000000005 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033799+0000", 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001777666 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037138+0000", 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00333943 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037256+0000", 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117754 2024-09-16T04:09:01.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:111 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.576816995999998, 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085961969999999999, 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031064+0000", 2024-09-16T04:09:01.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031065+0000", 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0100000000000005e-07 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031067+0000", 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031075+0000", 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.498e-06 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.031080+0000", 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3159999999999996e-06 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033632+0000", 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025523619999999999 2024-09-16T04:09:01.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.033720+0000", 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7457e-05 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037855+0000", 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041353259999999999 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.037942+0000", 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7039999999999993e-05 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.039661+0000", 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001718327 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:118 3.0s0 3:04de99e5:::smithi20431790-40:head [append 0~671744,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.645 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.565896467999998, 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078732079999999996, 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 118 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041985+0000", 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.041987+0000", 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9180000000000001e-06 2024-09-16T04:09:01.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042717+0000", 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073003100000000002 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042741+0000", 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4037e-05 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042755+0000", 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3828e-05 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042940+0000", 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018496100000000001 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.043139+0000", 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019973899999999999 2024-09-16T04:09:01.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044207+0000", 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001067822 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045575+0000", 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013682729999999999 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049772+0000", 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041967660000000002 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049858+0000", 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5833000000000003e-05 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.651 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:119 3.0s0 3:04de99e5:::smithi20431790-40:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.565094279999997, 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072748409999999998, 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 119 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042787+0000", 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042788+0000", 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.031e-06 2024-09-16T04:09:01.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042794+0000", 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5969999999999999e-06 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042805+0000", 2024-09-16T04:09:01.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1375999999999999e-05 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042812+0000", 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.613e-06 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044774+0000", 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019619059999999998 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.044887+0000", 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011298600000000001 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045362+0000", 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047594299999999999 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045858+0000", 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000495193 2024-09-16T04:09:01.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.049963+0000", 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041055500000000003 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050062+0000", 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8646000000000004e-05 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:120 3.0s0 3:04de99e5:::smithi20431790-40:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.565059284999997, 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091318960000000005, 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 120 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042823+0000", 2024-09-16T04:09:01.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0699999999999997e-07 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042825+0000", 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.441e-06 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042834+0000", 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4099999999999997e-06 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042840+0000", 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.728e-06 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045635+0000", 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027951059999999999 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045745+0000", 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109392 2024-09-16T04:09:01.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050479+0000", 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047341659999999997 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050579+0000", 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9852999999999994e-05 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.051954+0000", 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013752930000000001 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:136 3.0s0 3:0316444d:::smithi20431790-46:head [append 0~770048,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.537066004000003, 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006793075, 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070815+0000", 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.070817+0000", 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.911e-06 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071720+0000", 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00090319599999999999 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071743+0000", 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3003e-05 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071755+0000", 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1157e-05 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071832+0000", 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7206999999999994e-05 2024-09-16T04:09:01.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071946+0000", 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114251 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.072639+0000", 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069292699999999997 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074184+0000", 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015451639999999999 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077540+0000", 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556760000000001 2024-09-16T04:09:01.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077608+0000", 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8583000000000004e-05 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:138 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.536061132999997, 2024-09-16T04:09:01.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098477340000000003, 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071821+0000", 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0399999999999996e-07 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071824+0000", 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9639999999999999e-06 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071833+0000", 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7879999999999995e-06 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071839+0000", 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9959999999999999e-06 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074071+0000", 2024-09-16T04:09:01.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022326329999999999 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074173+0000", 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101989 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078912+0000", 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047384030000000004 2024-09-16T04:09:01.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078998+0000", 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6192000000000004e-05 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081668+0000", 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002670165 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:188 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~589824] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.617592608000002, 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016933011000000001, 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.676 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 188 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990292+0000", 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9330000000000001e-06 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991612+0000", 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319888 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991650+0000", 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8581999999999998e-05 2024-09-16T04:09:01.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991668+0000", 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8051999999999999e-05 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991865+0000", 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000196403 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:09:01.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991887+0000", 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2492000000000001e-05 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995547+0000", 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036596369999999999 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995693+0000", 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146136 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998906+0000", 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032132800000000002 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005918+0000", 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070119850000000001 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007080+0000", 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001161673 2024-09-16T04:09:01.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007222+0000", 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014195000000000001 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:189 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~376832] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.611314129999997, 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012452869, 2024-09-16T04:09:01.682 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 189 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:09:01.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996570+0000", 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.756e-06 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997415+0000", 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00084544299999999998 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997456+0000", 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0561e-05 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997484+0000", 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8129000000000001e-05 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000795+0000", 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033113959999999999 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000996+0000", 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020074599999999999 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:09:01.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018127729999999999 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005921+0000", 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003112489 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.008866+0000", 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029447100000000001 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009020+0000", 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015386600000000001 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:190 3.9s0 3:9410ed93:::smithi20431790-37:head [setxattr _header (56) in=7b] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.610351813999998, 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012174411, 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.688 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 190 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997531+0000", 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-06 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997540+0000", 2024-09-16T04:09:01.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999999e-06 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997567+0000", 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7121e-05 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997598+0000", 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003915+0000", 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006316627 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.004057+0000", 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141512 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005216+0000", 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011591800000000001 2024-09-16T04:09:01.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006552+0000", 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001335955 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009553+0000", 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030017009999999998 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009704+0000", 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015053199999999999 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:191 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.610233612999998, 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015318632, 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.694 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 191 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997649+0000", 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.533e-06 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997657+0000", 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-06 2024-09-16T04:09:01.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997681+0000", 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3952e-05 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997701+0000", 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0378999999999999e-05 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007640+0000", 2024-09-16T04:09:01.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099382580000000002 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007780+0000", 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140369 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010437+0000", 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002657459 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010564+0000", 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012679299999999999 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.012966+0000", 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024021590000000001 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:413 3.0s0 3:04de99e5:::smithi20431790-40:head [create,setxattr jmliR (209) in=5b,setxattr eRqQZNtlPRVjcgdjmbSmOsUSjSlU]tSoVjr`^oRN (489) in=40b,setxattr aR (209) in=2b,setxattr QP`igcZgYZ`X]j_`ObrUNcR_gQZW^mQs_T`XhhQp (10033) in=40b,setxattr V[thp]nUrl^Xata^al[oh[d`ddg`p[siljQWZ^\\X (350) in=40b,setxattr Pp[amim]nQkdfb][ca]Rhonh_mr`cpapUabYUfb\\ (9612) in=40b,setxattr jecnmafmfg__r^\\S_sU]bi]kYaplTcttSSX`\\prR (18524) in=40b,setxattr fVRh^qlag^rjpdaqVk`^r]eR`P[XUlr]]agZjWq[ (1998) in=40b,setxattr hgq\\iqsggNPTRPQok (209) in=17b,setxattr frZXQX\\isoq]gmjs`rk]PiQ\\fV[RTNPNYN]YV[mq (842) in=40b,setxattr `U`PSXddYml`lYXX[sSNnPfg`VgWbXsYnftUQ`it (558) in=40b,setxattr h\\bUdlZ]kknhkaaYeTcclaXatghTgbVrhNQblto_ (946) in=40b,setxattr XgcaedbaNamUmoa^d[dhg[arrjeikfUlToSjsbY` (877) in=40b,setxattr QXqRngrniZSrdNdQaffOsm_g_pYQoedrXoNqT[mn (561) in=40b,setxattr ][ifNPWgaZd[^RnfpRhWbfS\\^a]m[\\[ienetlUUZ (173) in=40b,setxattr mnhUacnNajpOrNecmPZT[OUj[XaWmU (209) in=30b,setxattr ZcXlR_O_^fXfTQrt`cZfOgVlmhepod\\^\\`socsW` (16348) in=40b,setxattr rZrXsckW]Y`iWQiRn (209) in=17b,setxattr peUYXiNb_UsOaXnhlX_s_[QTW_SoUaN]Wal`rkao (1997) in=40b,setxattr eNsVcjeRcj\\m]Q[VhYdSqNcmPhhR[UPR^ORSk_Vd (1823) in=40b] snapc c=[c,a,9] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:09:01.699 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.539906461000001, 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069071089999999998, 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 413 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067975+0000", 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.067978+0000", 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0809999999999998e-06 2024-09-16T04:09:01.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068117+0000", 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013882400000000001 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068146+0000", 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9218e-05 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068160+0000", 2024-09-16T04:09:01.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4474000000000001e-05 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068234+0000", 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3287000000000005e-05 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.068326+0000", 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2238999999999996e-05 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.069117+0000", 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079102700000000003 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.070488+0000", 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013705430000000001 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.074811+0000", 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043237340000000001 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:36.074882+0000", 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0681999999999999e-05 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:437 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.070909+0000", 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.536971825999998, 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073092299999999999, 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.705 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 437 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070909+0000", 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070909+0000", 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070912+0000", 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.915e-06 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070927+0000", 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4788e-05 2024-09-16T04:09:01.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070955+0000", 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8144999999999999e-05 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.070968+0000", 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2792999999999999e-05 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071042+0000", 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3402e-05 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071050+0000", 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4039999999999995e-06 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.072981+0000", 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001930927 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073081+0000", 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100139 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.078219+0000", 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005137717 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:438 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.536879622000001, 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085326459999999996, 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071002+0000", 2024-09-16T04:09:01.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5300000000000004e-07 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071007+0000", 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7249999999999997e-06 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071015+0000", 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071021+0000", 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4620000000000001e-06 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071104+0000", 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2933e-05 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071108+0000", 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.461e-06 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073470+0000", 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002361859 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073554+0000", 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4116999999999994e-05 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.079534+0000", 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059806620000000003 2024-09-16T04:09:01.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:439 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.536850833999999, 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095037699999999999, 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 439 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071031+0000", 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-07 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071035+0000", 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.476e-06 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071042+0000", 2024-09-16T04:09:01.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8569999999999997e-06 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071050+0000", 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4410000000000004e-06 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071119+0000", 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9746999999999995e-05 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071122+0000", 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.869e-06 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073841+0000", 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027184179999999998 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073967+0000", 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012589400000000001 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.080534+0000", 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065675780000000001 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:658 3.0s0 3:0316444d:::smithi20431790-46:head [create,setxattr Z]ca\\SkkXhsYi]s_mecUZQfPbbjaqacZrSObr_`a (734) in=40b,setxattr i (1998) in=1b,setxattr OQosgYUVOPebZdfit`Xtcc]XX_pdNqdkSof_lrck (1822) in=40b,setxattr mrQaYTllqfj^q]UYaoR`drdgY]bVfYQ\\SgOe_gca (1789) in=40b,setxattr ZaeONfchPlXaOYt[dQNtaR[NNiaSangpfQNVhVY[ (1646) in=40b,setxattr epskr[spqr^j^XqcosqPQ (1998) in=21b,setxattr WarqdipUlkSQhTbQR[NhrYRrda[QmOgj^VqWWero (313) in=40b,setxattr f\\fnrpSa`gWXj`Yo`dQY]Vdr[Z^`gkVjb^enmUig (1645) in=40b,setxattr bjWaN_RafX`the (1998) in=14b,setxattr nmdNljVWb`aR_`Oeb[l_OntR_YgidWjRabRf[]Ye (10596) in=40b,setxattr [nhisfmkVd_n_YV\\efebsW_pQaiWle_]o]rhc[bO (14456) in=40b,setxattr []hmkY]V]hkrrd]gr\\c\\hPq_smnTfakPZRNg^bY[ (1649) in=40b,setxattr ZZ\\\\jZnU`jtY\\[k]hnm`r_OYQeWTg\\rnQdX^rbhg (807) in=40b,setxattr QT_d^gX[dNZPP\\VapoetR^[gpVcZQXfhp^`l_Vh[ (66) in=40b,setxattr ee[ (1998) in=3b,setxattr RY\\sp]UifT[Zt\\[VenNWarqiiNSXsdnktf^QhT[U (487) in=40b,setxattr hUnl\\fnak]U``QN^rs`a^kfaQ`NoTVNnPXYbdmre (13680) in=40b,setxattr gha[S`afeloOcnfbeOkUV]T]ZTYWaOeaS]bbVa\\Q (1226) in=40b,setxattr NaraXbinjWQraPh`Pp]qnPWgWfZf[WaUb]oOY]^r (1611) in=40b,setxattr tpfZiddi]a^RVWpgOZormUeqYosdY_UsSpiQQRgj (1225) in=40b] snapc 14=[14,13] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7168008090000004, 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089480040000000007, 2024-09-16T04:09:01.721 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 658 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891085+0000", 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6970000000000001e-06 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891315+0000", 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022967199999999999 2024-09-16T04:09:01.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891341+0000", 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5673999999999998e-05 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891351+0000", 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0013000000000001e-05 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891476+0000", 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012553900000000001 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891490+0000", 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4047e-05 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.893817+0000", 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023270819999999998 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.893904+0000", 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6553999999999998e-05 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.894635+0000", 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073132899999999996 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.895889+0000", 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012542040000000001 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.899945+0000", 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040559890000000003 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.900029+0000", 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3203999999999998e-05 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:01.727 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:01.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:09:01.730 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:01.727+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:01.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:09:01.826+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:09:01.866 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:01.866 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:01.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:09:01.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-16T04:09:01.890 INFO:tasks.rados.rados.0.smithi204.stdout:320: done (5 left) 2024-09-16T04:09:01.890 INFO:tasks.rados.rados.0.smithi204.stdout:321: rollback oid 33 current snap is 23 2024-09-16T04:09:01.890 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 33 to 22 2024-09-16T04:09:01.891 INFO:tasks.rados.rados.0.smithi204.stdout:313: expect (ObjNum 113 snap 19 seq_num 113) 2024-09-16T04:09:01.931 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:09:01.926+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:09:02.008 INFO:tasks.rados.rados.0.smithi204.stdout:312: finishing write tid 5 to smithi20431790-15 2024-09-16T04:09:02.008 INFO:tasks.rados.rados.0.smithi204.stdout:312: finishing write tid 6 to smithi20431790-15 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: oid 15 updating version 0 to 98 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: oid 15 updating version 98 to 100 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: oid 15 version 100 is already newer than 97 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: oid 15 version 100 is already newer than 96 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: oid 15 version 100 is already newer than 99 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 15 v 100 (ObjNum 133 snap 23 seq_num 133) dirty exists 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:312: left oid 15 (ObjNum 133 snap 23 seq_num 133) 2024-09-16T04:09:02.009 INFO:tasks.rados.rados.0.smithi204.stdout:314: expect (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:09:02.016 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:02.016 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:02.016 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:02.016 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:02.016 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:02.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:09:02.032 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:09:02.029+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:318: finishing write tid 1 to smithi20431790-13 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:318: finishing write tid 2 to smithi20431790-13 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:319: finishing rollback tid 0 to smithi20431790-27 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:318: finishing write tid 3 to smithi20431790-13 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:312: done (5 left) 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:313: done (4 left) 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:314: done (3 left) 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:322: rollback oid 39 current snap is 23 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 39 to 22 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:318: finishing write tid 4 to smithi20431790-13 2024-09-16T04:09:02.056 INFO:tasks.rados.rados.0.smithi204.stdout:319: finishing rollback tid 1 to smithi20431790-27 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:319: finishing rollback tid 2 to smithi20431790-27 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 27 v 47 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: finishing write tid 5 to smithi20431790-13 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: finishing write tid 6 to smithi20431790-13 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: oid 13 updating version 0 to 104 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: oid 13 updating version 104 to 105 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: oid 13 updating version 105 to 106 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: oid 13 version 106 is already newer than 102 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: oid 13 version 106 is already newer than 103 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 13 v 106 (ObjNum 135 snap 23 seq_num 135) dirty exists 2024-09-16T04:09:02.057 INFO:tasks.rados.rados.0.smithi204.stdout:318: left oid 13 (ObjNum 135 snap 23 seq_num 135) 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:321: finishing rollback tid 0 to smithi20431790-33 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:321: finishing rollback tid 1 to smithi20431790-33 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:321: finishing rollback tid 2 to smithi20431790-33 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 33 v 55 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:318: done (3 left) 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:319: done (2 left) 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:321: done (1 left) 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:323: read oid 16 snap -1 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:323: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 10 current snap is 23 2024-09-16T04:09:02.058 INFO:tasks.rados.rados.0.smithi204.stdout:324: seq_num 136 ranges {3883008=737280,4620288=770048,5390336=540672,5931008=245760} 2024-09-16T04:09:02.103 INFO:tasks.rados.rados.0.smithi204.stdout:324: writing smithi20431790-10 from 3883008 to 4620288 tid 1 2024-09-16T04:09:02.111 INFO:tasks.rados.rados.0.smithi204.stdout:324: writing smithi20431790-10 from 4620288 to 5390336 tid 2 2024-09-16T04:09:02.116 INFO:tasks.rados.rados.0.smithi204.stdout:324: writing smithi20431790-10 from 5390336 to 5931008 tid 3 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:324: writing smithi20431790-10 from 5931008 to 6176768 tid 4 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:325: read oid 3 snap -1 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:325: expect (ObjNum 118 snap 22 seq_num 118) 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:326: rmattr oid 11 current snap is 23 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:326: done (4 left) 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 24 current snap is 23 2024-09-16T04:09:02.119 INFO:tasks.rados.rados.0.smithi204.stdout:327: seq_num 137 ranges {2015232=753664,2768896=786432,3555328=655360,4210688=114688} 2024-09-16T04:09:02.134 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:09:02.129+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:09:02.139 INFO:tasks.rados.rados.0.smithi204.stdout:327: writing smithi20431790-24 from 2015232 to 2768896 tid 1 2024-09-16T04:09:02.144 INFO:tasks.rados.rados.0.smithi204.stdout:327: writing smithi20431790-24 from 2768896 to 3555328 tid 2 2024-09-16T04:09:02.148 INFO:tasks.rados.rados.0.smithi204.stdout:327: writing smithi20431790-24 from 3555328 to 4210688 tid 3 2024-09-16T04:09:02.148 INFO:tasks.rados.rados.0.smithi204.stdout:327: writing smithi20431790-24 from 4210688 to 4325376 tid 4 2024-09-16T04:09:02.149 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 22 current snap is 23 2024-09-16T04:09:02.149 INFO:tasks.rados.rados.0.smithi204.stdout:328: seq_num 138 ranges {1703936=770048,2473984=540672,3014656=753664,3768320=262144} 2024-09-16T04:09:02.162 INFO:tasks.rados.rados.0.smithi204.stdout:328: writing smithi20431790-22 from 1703936 to 2473984 tid 1 2024-09-16T04:09:02.165 INFO:tasks.rados.rados.0.smithi204.stdout:328: writing smithi20431790-22 from 2473984 to 3014656 tid 2 2024-09-16T04:09:02.170 INFO:tasks.rados.rados.0.smithi204.stdout:328: writing smithi20431790-22 from 3014656 to 3768320 tid 3 2024-09-16T04:09:02.172 INFO:tasks.rados.rados.0.smithi204.stdout:328: writing smithi20431790-22 from 3768320 to 4030464 tid 4 2024-09-16T04:09:02.172 INFO:tasks.rados.rados.0.smithi204.stdout:329: rollback oid 29 current snap is 23 2024-09-16T04:09:02.172 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 29 to 22 2024-09-16T04:09:02.172 INFO:tasks.rados.rados.0.smithi204.stdout:322: finishing rollback tid 0 to smithi20431790-39 2024-09-16T04:09:02.172 INFO:tasks.rados.rados.0.smithi204.stdout:323: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.233235579000002, 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080395369999999994, 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936932+0000", 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0530000000000001e-06 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937019+0000", 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7212000000000005e-05 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937052+0000", 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3331000000000003e-05 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937092+0000", 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9437000000000002e-05 2024-09-16T04:09:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937324+0000", 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023248400000000001 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937349+0000", 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5398e-05 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944874+0000", 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075243269999999999 2024-09-16T04:09:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944969+0000", 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5295000000000002e-05 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.228263738999999, 2024-09-16T04:09:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063272570000000002, 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941903+0000", 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.457e-06 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942075+0000", 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017237900000000001 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942114+0000", 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8433000000000003e-05 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942137+0000", 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3442e-05 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944009+0000", 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018714789999999999 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944031+0000", 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2912e-05 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948133+0000", 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041011930000000004 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948229+0000", 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5962e-05 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.227818216000003, 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059926320000000003, 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942348+0000", 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2300000000000001e-06 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942388+0000", 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0377000000000003e-05 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942419+0000", 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0957000000000002e-05 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942449+0000", 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9578e-05 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945390+0000", 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029405360000000001 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945413+0000", 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3901999999999999e-05 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948238+0000", 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028249 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948339+0000", 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101152 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.194090952000003, 2024-09-16T04:09:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064471959999999997, 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:09:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976076+0000", 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9429999999999999e-06 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976477+0000", 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000400567 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976509+0000", 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2762999999999998e-05 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976533+0000", 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3167999999999999e-05 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976778+0000", 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245324 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976803+0000", 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4780999999999999e-05 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982391+0000", 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055884929999999999 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982521+0000", 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013015699999999999 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:09:02.192 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.190567553000001, 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072774700000000003, 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:09:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979599+0000", 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8530000000000001e-06 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979644+0000", 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4736e-05 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979677+0000", 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2681000000000001e-05 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979701+0000", 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3754999999999999e-05 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979867+0000", 2024-09-16T04:09:02.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166689 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979890+0000", 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3264e-05 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986795+0000", 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069048069999999998 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986875+0000", 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9684999999999993e-05 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.186975169999997, 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076880730000000001, 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.197 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983192+0000", 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983586+0000", 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039456700000000002 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983617+0000", 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0574000000000002e-05 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983639+0000", 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2178999999999999e-05 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983866+0000", 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227366 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983888+0000", 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1804e-05 2024-09-16T04:09:02.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990760+0000", 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068715030000000002 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990878+0000", 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011824600000000001 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=16, reqid=client.4631.0:56, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.185221458999997, 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064676780000000001, 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984946+0000", 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984990+0000", 2024-09-16T04:09:02.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3776000000000002e-05 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985022+0000", 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2345999999999998e-05 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985043+0000", 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1549999999999999e-05 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985376+0000", 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033260599999999999 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985400+0000", 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4015e-05 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991311+0000", 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059112239999999996 2024-09-16T04:09:02.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991411+0000", 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010003199999999999 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds1 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.183538849000001, 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059755490000000001, 2024-09-16T04:09:02.206 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986628+0000", 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.905e-06 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986905+0000", 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027719099999999998 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986953+0000", 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8182e-05 2024-09-16T04:09:02.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986976+0000", 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2997999999999999e-05 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987170+0000", 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193217 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987190+0000", 2024-09-16T04:09:02.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0588999999999999e-05 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992498+0000", 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053074669999999997 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992602+0000", 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010399999999999999 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 36.135900438, 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062924130000000002, 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034266+0000", 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034464+0000", 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000198808 2024-09-16T04:09:02.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034506+0000", 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.197e-05 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034540+0000", 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3098000000000001e-05 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034723+0000", 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018367500000000001 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034753+0000", 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9292e-05 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040460+0000", 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057071020000000004 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040557+0000", 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7400999999999998e-05 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.139302260999997, 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061099889999999997, 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.215 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030927+0000", 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3188999999999994e-05 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030971+0000", 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4634e-05 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030995+0000", 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4032e-05 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031211+0000", 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021563299999999999 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031241+0000", 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0329e-05 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036878+0000", 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056365449999999997 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036973+0000", 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5047e-05 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=216, reqid=client.4631.0:301, at_version=0'0, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:09:02.219 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.114383427999996, 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059219310000000001, 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055784+0000", 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9929999999999998e-06 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055815+0000", 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055858+0000", 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3096999999999998e-05 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055879+0000", 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1688999999999999e-05 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056067+0000", 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018760099999999999 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056101+0000", 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3775000000000001e-05 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061623+0000", 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055219730000000003 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061704+0000", 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0897999999999997e-05 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.317140755, 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058830389999999996, 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:09:02.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853026+0000", 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0899999999999999e-06 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853087+0000", 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0560000000000003e-05 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853119+0000", 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2104999999999998e-05 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853144+0000", 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4912000000000001e-05 2024-09-16T04:09:02.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855175+0000", 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002031007 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855211+0000", 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5680999999999999e-05 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858817+0000", 2024-09-16T04:09:02.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036060860000000001 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858907+0000", 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0598000000000002e-05 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.228 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.316961980999999, 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098485320000000001, 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853204+0000", 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0300000000000001e-06 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853263+0000", 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9006999999999999e-05 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853290+0000", 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6520999999999999e-05 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853309+0000", 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9826e-05 2024-09-16T04:09:02.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857423+0000", 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041136109999999997 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1618000000000001e-05 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862892+0000", 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005437491 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863052+0000", 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015942800000000001 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:09:02.233 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.316675734, 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069765720000000003, 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:09:02.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853490+0000", 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3699999999999999e-07 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853601+0000", 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111047 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853629+0000", 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7568000000000001e-05 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853648+0000", 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9199e-05 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857263+0000", 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036145560000000001 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857285+0000", 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2382e-05 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860374+0000", 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030894009999999999 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860466+0000", 2024-09-16T04:09:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1582000000000005e-05 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.314330480999999, 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072392969999999996, 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855836+0000", 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3699999999999999e-07 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855889+0000", 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.346e-05 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855913+0000", 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3635e-05 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855930+0000", 2024-09-16T04:09:02.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7499e-05 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857410+0000", 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001480121 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857433+0000", 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2582000000000002e-05 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862976+0000", 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055433549999999998 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863074+0000", 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7707999999999994e-05 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 54/31 ECSubWrite(tid=254, reqid=osd.11.0:254, at_version=54'19, trim_to=0'0, roll_forward_to=52'17))", 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:02.242 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.101800428000001, 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078273349999999995, 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:02.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6000000000000003e-07 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068423+0000", 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7707000000000002e-05 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068454+0000", 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0882e-05 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068478+0000", 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4362000000000002e-05 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068698+0000", 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021970299999999999 2024-09-16T04:09:02.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068725+0000", 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7279000000000001e-05 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076089+0000", 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0073640800000000003 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076192+0000", 2024-09-16T04:09:02.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102662 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.101595544999999, 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076635829999999999, 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068571+0000", 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1599999999999999e-06 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068645+0000", 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4610999999999994e-05 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068672+0000", 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6710999999999999e-05 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068692+0000", 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0373e-05 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068869+0000", 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017663499999999999 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068896+0000", 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7231999999999999e-05 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076166+0000", 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007269948 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076233+0000", 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6913000000000001e-05 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.251 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.098872655000001, 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074803539999999998, 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071293+0000", 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1699999999999998e-07 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071345+0000", 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1811000000000003e-05 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071377+0000", 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2061999999999999e-05 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071404+0000", 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7072000000000001e-05 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071568+0000", 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163609 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071626+0000", 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8811000000000003e-05 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078616+0000", 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069891459999999999 2024-09-16T04:09:02.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078773+0000", 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157226 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 75/31 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=75'61, trim_to=0'0, roll_forward_to=74'59))", 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.868731+0000", 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3014337899999999, 2024-09-16T04:09:02.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065364189999999999, 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868731+0000", 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868731+0000", 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868732+0000", 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868786+0000", 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4314999999999998e-05 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868820+0000", 2024-09-16T04:09:02.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3532999999999999e-05 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868847+0000", 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7509e-05 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869014+0000", 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016654500000000001 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869044+0000", 2024-09-16T04:09:02.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9916e-05 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875193+0000", 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061493889999999999 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875268+0000", 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4407999999999996e-05 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.260 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 79/31 ECSubWrite(tid=210, reqid=osd.13.0:208, at_version=0'0, trim_to=0'0, roll_forward_to=79'71))", 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:01.901739+0000", 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.26842651000000001, 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064141609999999998, 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901739+0000", 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901739+0000", 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901740+0000", 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9369999999999998e-06 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901768+0000", 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7416e-05 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901801+0000", 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.269e-05 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901823+0000", 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1909e-05 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.906488+0000", 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046659809999999996 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.906513+0000", 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4814999999999999e-05 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.908119+0000", 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016054789999999999 2024-09-16T04:09:02.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.908153+0000", 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3933999999999997e-05 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.265 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:02.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:09:02.269 INFO:tasks.rados.rados.0.smithi204.stdout:322: finishing rollback tid 1 to smithi20431790-39 2024-09-16T04:09:02.269 INFO:tasks.rados.rados.0.smithi204.stdout:322: finishing rollback tid 2 to smithi20431790-39 2024-09-16T04:09:02.269 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-16T04:09:02.269 INFO:tasks.rados.rados.0.smithi204.stdout:324: finishing write tid 1 to smithi20431790-10 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:324: finishing write tid 2 to smithi20431790-10 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:324: finishing write tid 3 to smithi20431790-10 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:324: finishing write tid 4 to smithi20431790-10 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:324: finishing write tid 5 to smithi20431790-10 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:322: done (6 left) 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:323: done (5 left) 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 26 current snap is 23 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:330: seq_num 139 ranges {0=786432,786432=688128,1474560=475136,1949696=393216} 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:330: writing smithi20431790-26 from 0 to 786432 tid 1 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:330: writing smithi20431790-26 from 786432 to 1474560 tid 2 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:330: writing smithi20431790-26 from 1474560 to 1949696 tid 3 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:330: writing smithi20431790-26 from 1949696 to 2342912 tid 4 2024-09-16T04:09:02.270 INFO:tasks.rados.rados.0.smithi204.stdout:331: read oid 39 snap 22 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:331: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 16 current snap is 23 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:332: seq_num 140 ranges {262144=802816,1064960=425984,1490944=720896,2211840=409600} 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:332: writing smithi20431790-16 from 262144 to 1064960 tid 1 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:332: writing smithi20431790-16 from 1064960 to 1490944 tid 2 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:332: writing smithi20431790-16 from 1490944 to 2211840 tid 3 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:332: writing smithi20431790-16 from 2211840 to 2621440 tid 4 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:333: rollback oid 30 current snap is 23 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 30 to 22 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:334: rmattr oid 28 current snap is 23 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:334: done (9 left) 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:335: read oid 50 snap 22 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:335: expect (ObjNum 89 snap 11 seq_num 89) 2024-09-16T04:09:02.271 INFO:tasks.rados.rados.0.smithi204.stdout:336: delete oid 31 current snap is 23 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: finishing write tid 6 to smithi20431790-10 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: oid 10 updating version 0 to 140 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: oid 10 version 140 is already newer than 139 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: oid 10 updating version 140 to 142 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: oid 10 version 142 is already newer than 141 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: oid 10 updating version 142 to 143 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 10 v 143 (ObjNum 136 snap 23 seq_num 136) dirty exists 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:324: left oid 10 (ObjNum 136 snap 23 seq_num 136) 2024-09-16T04:09:02.272 INFO:tasks.rados.rados.0.smithi204.stdout:325: expect (ObjNum 118 snap 22 seq_num 118) 2024-09-16T04:09:02.272 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:02.263+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:02.349 INFO:tasks.rados.rados.0.smithi204.stdout:327: finishing write tid 1 to smithi20431790-24 2024-09-16T04:09:02.349 INFO:tasks.rados.rados.0.smithi204.stdout:327: finishing write tid 2 to smithi20431790-24 2024-09-16T04:09:02.349 INFO:tasks.rados.rados.0.smithi204.stdout:327: finishing write tid 3 to smithi20431790-24 2024-09-16T04:09:02.349 INFO:tasks.rados.rados.0.smithi204.stdout:327: finishing write tid 4 to smithi20431790-24 2024-09-16T04:09:02.349 INFO:tasks.rados.rados.0.smithi204.stdout:327: finishing write tid 5 to smithi20431790-24 2024-09-16T04:09:02.349 INFO:tasks.rados.rados.0.smithi204.stdout:327: finishing write tid 6 to smithi20431790-24 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:327: oid 24 updating version 0 to 77 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:327: oid 24 version 77 is already newer than 75 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:327: oid 24 version 77 is already newer than 76 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:327: oid 24 updating version 77 to 79 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:327: oid 24 version 79 is already newer than 78 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 24 v 79 (ObjNum 137 snap 23 seq_num 137) dirty exists 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:327: left oid 24 (ObjNum 137 snap 23 seq_num 137) 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:328: finishing write tid 1 to smithi20431790-22 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:328: finishing write tid 2 to smithi20431790-22 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:329: finishing rollback tid 1 to smithi20431790-29 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 29 v 0 (ObjNum 129 snap 0 seq_num 1076126704) dirty dne 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:328: finishing write tid 3 to smithi20431790-22 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:328: finishing write tid 4 to smithi20431790-22 2024-09-16T04:09:02.350 INFO:tasks.rados.rados.0.smithi204.stdout:328: finishing write tid 5 to smithi20431790-22 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: finishing write tid 6 to smithi20431790-22 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: oid 22 updating version 0 to 76 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: oid 22 version 76 is already newer than 73 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: oid 22 version 76 is already newer than 75 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: oid 22 updating version 76 to 77 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: oid 22 version 77 is already newer than 74 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 22 v 77 (ObjNum 138 snap 23 seq_num 138) dirty exists 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: left oid 22 (ObjNum 138 snap 23 seq_num 138) 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:330: finishing write tid 1 to smithi20431790-26 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:330: finishing write tid 2 to smithi20431790-26 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:324: done (10 left) 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:325: done (9 left) 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:327: done (8 left) 2024-09-16T04:09:02.351 INFO:tasks.rados.rados.0.smithi204.stdout:328: done (7 left) 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:329: done (6 left) 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:336: done (5 left) 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:337: read oid 42 snap -1 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:337: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:338: rmattr oid 5 current snap is 23 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:330: finishing write tid 3 to smithi20431790-26 2024-09-16T04:09:02.352 INFO:tasks.rados.rados.0.smithi204.stdout:331: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:09:02.365 INFO:tasks.rados.rados.0.smithi204.stdout:330: finishing write tid 4 to smithi20431790-26 2024-09-16T04:09:02.365 INFO:tasks.rados.rados.0.smithi204.stdout:332: finishing write tid 1 to smithi20431790-16 2024-09-16T04:09:02.365 INFO:tasks.rados.rados.0.smithi204.stdout:331: done (6 left) 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:339: rollback oid 44 current snap is 23 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 44 to 22 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:330: finishing write tid 5 to smithi20431790-26 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:333: finishing rollback tid 0 to smithi20431790-30 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:333: finishing rollback tid 1 to smithi20431790-30 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:332: finishing write tid 2 to smithi20431790-16 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:332: finishing write tid 3 to smithi20431790-16 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:333: finishing rollback tid 2 to smithi20431790-30 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 189 (ObjNum 114 snap 21 seq_num 114) dirty exists 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:330: finishing write tid 6 to smithi20431790-26 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:330: oid 26 updating version 0 to 13 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:330: oid 26 updating version 13 to 14 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:330: oid 26 updating version 14 to 15 2024-09-16T04:09:02.366 INFO:tasks.rados.rados.0.smithi204.stdout:330: oid 26 version 15 is already newer than 12 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:330: oid 26 updating version 15 to 16 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 26 v 16 (ObjNum 139 snap 23 seq_num 139) dirty exists 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:330: left oid 26 (ObjNum 139 snap 23 seq_num 139) 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: finishing write tid 4 to smithi20431790-16 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: finishing write tid 5 to smithi20431790-16 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: finishing write tid 6 to smithi20431790-16 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: oid 16 updating version 0 to 149 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: oid 16 version 149 is already newer than 146 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: oid 16 version 149 is already newer than 148 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: oid 16 version 149 is already newer than 145 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: oid 16 version 149 is already newer than 147 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 16 v 149 (ObjNum 140 snap 23 seq_num 140) dirty exists 2024-09-16T04:09:02.367 INFO:tasks.rados.rados.0.smithi204.stdout:332: left oid 16 (ObjNum 140 snap 23 seq_num 140) 2024-09-16T04:09:02.368 INFO:tasks.rados.rados.0.smithi204.stdout:335: expect (ObjNum 89 snap 11 seq_num 89) 2024-09-16T04:09:02.369 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:02.365+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:02.406 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:02.406 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:02.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:09:02.469 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:02.465+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:02.509 INFO:tasks.rados.rados.0.smithi204.stdout:337: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-16T04:09:02.516 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 192 (ObjNum 88 snap 11 seq_num 88) dirty exists 2024-09-16T04:09:02.516 INFO:tasks.rados.rados.0.smithi204.stdout:339: finishing rollback tid 0 to smithi20431790-44 2024-09-16T04:09:02.516 INFO:tasks.rados.rados.0.smithi204.stdout:339: finishing rollback tid 1 to smithi20431790-44 2024-09-16T04:09:02.516 INFO:tasks.rados.rados.0.smithi204.stdout:339: finishing rollback tid 2 to smithi20431790-44 2024-09-16T04:09:02.516 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 83 (ObjNum 91 snap 13 seq_num 91) dirty exists 2024-09-16T04:09:02.516 INFO:tasks.rados.rados.0.smithi204.stdout:330: done (6 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:332: done (5 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:333: done (4 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:335: done (3 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:337: done (2 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:338: done (1 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:339: done (0 left) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:340: read oid 28 snap -1 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:340: expect (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:341: read oid 25 snap 22 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:341: expect (ObjNum 24 snap 0 seq_num 24) 2024-09-16T04:09:02.517 INFO:tasks.rados.rados.0.smithi204.stdout:342: delete oid 27 current snap is 23 2024-09-16T04:09:02.522 INFO:tasks.rados.rados.0.smithi204.stdout:342: done (2 left) 2024-09-16T04:09:02.523 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 36 current snap is 23 2024-09-16T04:09:02.523 INFO:tasks.rados.rados.0.smithi204.stdout:343: seq_num 143 ranges {1605632=458752,2064384=475136,2539520=655360,3194880=671744,3866624=147456} 2024-09-16T04:09:02.537 INFO:tasks.rados.rados.0.smithi204.stdout:343: writing smithi20431790-36 from 1605632 to 2064384 tid 1 2024-09-16T04:09:02.546 INFO:tasks.rados.rados.0.smithi204.stdout:343: writing smithi20431790-36 from 2064384 to 2539520 tid 2 2024-09-16T04:09:02.552 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:02.552 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:02.552 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:02.552 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:02.552 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:02.556 INFO:tasks.rados.rados.0.smithi204.stdout:343: writing smithi20431790-36 from 2539520 to 3194880 tid 3 2024-09-16T04:09:02.565 INFO:tasks.rados.rados.0.smithi204.stdout:343: writing smithi20431790-36 from 3194880 to 3866624 tid 4 2024-09-16T04:09:02.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:09:02.568 INFO:tasks.rados.rados.0.smithi204.stdout:343: writing smithi20431790-36 from 3866624 to 4014080 tid 5 2024-09-16T04:09:02.568 INFO:tasks.rados.rados.0.smithi204.stdout:344: copy_from oid 7 from oid 37 current snap is 23 2024-09-16T04:09:02.568 INFO:tasks.rados.rados.0.smithi204.stdout:341: expect (ObjNum 24 snap 0 seq_num 24) 2024-09-16T04:09:02.571 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:09:02.563+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:09:02.582 INFO:tasks.rados.rados.0.smithi204.stdout:340: expect (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 1 to smithi20431790-36 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 2 to smithi20431790-36 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 3 to smithi20431790-36 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:340: done (3 left) 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:341: done (2 left) 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:345: delete oid 42 current snap is 23 2024-09-16T04:09:02.643 INFO:tasks.rados.rados.0.smithi204.stdout:344: finishing copy_from to smithi20431790-7 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:344: got expected ENOENT (src dne) 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:344: finishing copy_from racing read to smithi20431790-7 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 4 to smithi20431790-36 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 5 to smithi20431790-36 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 6 to smithi20431790-36 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: finishing write tid 7 to smithi20431790-36 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: oid 36 updating version 0 to 21 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: oid 36 version 21 is already newer than 18 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: oid 36 updating version 21 to 23 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: oid 36 version 23 is already newer than 19 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: oid 36 version 23 is already newer than 22 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: oid 36 version 23 is already newer than 20 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 36 v 23 (ObjNum 143 snap 23 seq_num 143) dirty exists 2024-09-16T04:09:02.644 INFO:tasks.rados.rados.0.smithi204.stdout:343: left oid 36 (ObjNum 143 snap 23 seq_num 143) 2024-09-16T04:09:02.649 INFO:tasks.rados.rados.0.smithi204.stdout:343: done (2 left) 2024-09-16T04:09:02.650 INFO:tasks.rados.rados.0.smithi204.stdout:344: done (1 left) 2024-09-16T04:09:02.650 INFO:tasks.rados.rados.0.smithi204.stdout:345: done (0 left) 2024-09-16T04:09:02.650 INFO:tasks.rados.rados.0.smithi204.stdout:346: copy_from oid 30 from oid 29 current snap is 23 2024-09-16T04:09:02.650 INFO:tasks.rados.rados.0.smithi204.stdout:347: setattr oid 31 current snap is 23 2024-09-16T04:09:02.652 INFO:tasks.rados.rados.0.smithi204.stdout:346: finishing copy_from to smithi20431790-30 2024-09-16T04:09:02.652 INFO:tasks.rados.rados.0.smithi204.stdout:346: got expected ENOENT (src dne) 2024-09-16T04:09:02.652 INFO:tasks.rados.rados.0.smithi204.stdout:346: finishing copy_from racing read to smithi20431790-30 2024-09-16T04:09:02.653 INFO:tasks.rados.rados.0.smithi204.stdout:346: done (1 left) 2024-09-16T04:09:02.653 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 29 current snap is 23 2024-09-16T04:09:02.653 INFO:tasks.rados.rados.0.smithi204.stdout:348: seq_num 145 ranges {0=32768} 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:348: writing smithi20431790-29 from 0 to 32768 tid 1 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:349: copy_from oid 45 from oid 16 current snap is 23 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:350: rollback oid 32 current snap is 23 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 32 to 22 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:351: read oid 37 snap -1 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:351: expect deleted 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:352: rmattr oid 5 current snap is 23 2024-09-16T04:09:02.654 INFO:tasks.rados.rados.0.smithi204.stdout:353: setattr oid 18 current snap is 23 2024-09-16T04:09:02.655 INFO:tasks.rados.rados.0.smithi204.stdout:351: done (6 left) 2024-09-16T04:09:02.655 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 7 current snap is 23 2024-09-16T04:09:02.655 INFO:tasks.rados.rados.0.smithi204.stdout:354: seq_num 146 ranges {0=49152} 2024-09-16T04:09:02.656 INFO:tasks.rados.rados.0.smithi204.stdout:354: writing smithi20431790-7 from 0 to 49152 tid 1 2024-09-16T04:09:02.656 INFO:tasks.rados.rados.0.smithi204.stdout:355: rollback oid 30 current snap is 23 2024-09-16T04:09:02.656 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 30 to 22 2024-09-16T04:09:02.656 INFO:tasks.rados.rados.0.smithi204.stdout:356: rollback oid 20 current snap is 23 2024-09-16T04:09:02.657 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 20 to 22 2024-09-16T04:09:02.657 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 1 current snap is 23 2024-09-16T04:09:02.657 INFO:tasks.rados.rados.0.smithi204.stdout:357: seq_num 147 ranges {442368=65536} 2024-09-16T04:09:02.665 INFO:tasks.rados.rados.0.smithi204.stdout:357: writing smithi20431790-1 from 442368 to 507904 tid 1 2024-09-16T04:09:02.665 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 46 current snap is 23 2024-09-16T04:09:02.665 INFO:tasks.rados.rados.0.smithi204.stdout:358: seq_num 148 ranges {0=81920} 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:358: writing smithi20431790-46 from 0 to 81920 tid 1 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:359: read oid 50 snap 22 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:359: expect (ObjNum 89 snap 11 seq_num 89) 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:360: read oid 28 snap -1 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:360: expect (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 27 current snap is 23 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 18 v 107 (ObjNum 106 snap 16 seq_num 106) dirty exists 2024-09-16T04:09:02.667 INFO:tasks.rados.rados.0.smithi204.stdout:356: finishing rollback tid 1 to smithi20431790-20 2024-09-16T04:09:02.668 INFO:tasks.rados.rados.0.smithi204.stdout:356: finishing rollback tid 2 to smithi20431790-20 2024-09-16T04:09:02.668 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 20 v 79 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:09:02.668 INFO:tasks.rados.rados.0.smithi204.stdout:361: seq_num 149 ranges {0=98304} 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:361: writing smithi20431790-27 from 0 to 98304 tid 1 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:353: done (13 left) 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:356: done (12 left) 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:362: read oid 42 snap -1 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:362: expect deleted 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 25 current snap is 23 2024-09-16T04:09:02.669 INFO:tasks.rados.rados.0.smithi204.stdout:363: seq_num 150 ranges {409600=114688} 2024-09-16T04:09:02.673 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:09:02.667+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:09:02.677 INFO:tasks.rados.rados.0.smithi204.stdout:363: writing smithi20431790-25 from 409600 to 524288 tid 1 2024-09-16T04:09:02.678 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 31 v 193 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-09-16T04:09:02.678 INFO:tasks.rados.rados.0.smithi204.stdout:350: finishing rollback tid 1 to smithi20431790-32 2024-09-16T04:09:02.678 INFO:tasks.rados.rados.0.smithi204.stdout:350: finishing rollback tid 2 to smithi20431790-32 2024-09-16T04:09:02.678 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 32 v 49 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-16T04:09:02.678 INFO:tasks.rados.rados.0.smithi204.stdout:354: finishing write tid 1 to smithi20431790-7 2024-09-16T04:09:02.679 INFO:tasks.rados.rados.0.smithi204.stdout:348: finishing write tid 1 to smithi20431790-29 2024-09-16T04:09:02.679 INFO:tasks.rados.rados.0.smithi204.stdout:347: done (13 left) 2024-09-16T04:09:02.679 INFO:tasks.rados.rados.0.smithi204.stdout:350: done (12 left) 2024-09-16T04:09:02.679 INFO:tasks.rados.rados.0.smithi204.stdout:362: done (11 left) 2024-09-16T04:09:02.679 INFO:tasks.rados.rados.0.smithi204.stdout:364: snap_create 2024-09-16T04:09:02.679 INFO:tasks.rados.rados.0.smithi204.stdout:360: expect (ObjNum 111 snap 17 seq_num 111) 2024-09-16T04:09:02.712 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:34 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~196608,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.758649980999998, 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023419893000000001, 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 34 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949751+0000", 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3790000000000002e-06 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951559+0000", 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018085589999999999 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951588+0000", 2024-09-16T04:09:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8728e-05 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951607+0000", 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8817999999999998e-05 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951866+0000", 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025890800000000002 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952244+0000", 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378222 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.954553+0000", 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023090099999999998 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961470+0000", 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069174079999999999 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972971+0000", 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011500923999999999 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973167+0000", 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195937 2024-09-16T04:09:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:35 3.cs0 3:3ee250f2:::smithi20431790-12:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.756739650999997, 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.029134334000000001, 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 35 2024-09-16T04:09:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951660+0000", 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.176e-06 2024-09-16T04:09:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951673+0000", 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2799000000000001e-05 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951697+0000", 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4698e-05 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951715+0000", 2024-09-16T04:09:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7265000000000002e-05 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957234+0000", 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055191260000000001 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957565+0000", 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033102199999999999 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960023+0000", 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002458567 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.963486+0000", 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034622020000000002 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980404+0000", 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016918914 2024-09-16T04:09:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980792+0000", 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038756499999999998 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:36 3.cs0 3:3ee250f2:::smithi20431790-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.756657085000001, 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.045222315999999999, 2024-09-16T04:09:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 36 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951742+0000", 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951749+0000", 2024-09-16T04:09:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7190000000000001e-06 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951770+0000", 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0092e-05 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951785+0000", 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5162e-05 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961177+0000", 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093920979999999998 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961445+0000", 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268664 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981947+0000", 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020501287999999999 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982122+0000", 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017487899999999999 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996963+0000", 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014840901 2024-09-16T04:09:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:49 3.5s0 3:a07911e0:::smithi20431790-17:head [append 0~278528,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.743983088999997, 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017107101999999999, 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 49 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964417+0000", 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0529999999999998e-06 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964962+0000", 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054521099999999998 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964997+0000", 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4028e-05 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965020+0000", 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3553999999999998e-05 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965225+0000", 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020534700000000001 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965562+0000", 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000336332 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967943+0000", 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023810950000000002 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971887+0000", 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039443120000000002 2024-09-16T04:09:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981336+0000", 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0094491490000000004 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981521+0000", 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000185021 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:50 3.5s0 3:a07911e0:::smithi20431790-17:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.743296295999997, 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018470364999999999, 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 50 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965103+0000", 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965114+0000", 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1616e-05 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965139+0000", 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4711000000000001e-05 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965158+0000", 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8774999999999999e-05 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969089+0000", 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039314490000000001 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969306+0000", 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021679300000000001 2024-09-16T04:09:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.970337+0000", 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001030385 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974758+0000", 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044213810000000003 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983346+0000", 2024-09-16T04:09:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085879849999999994 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983571+0000", 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225427 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:51 3.5s0 3:a07911e0:::smithi20431790-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.743202730999997, 2024-09-16T04:09:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022912589000000001, 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 51 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965196+0000", 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5e-06 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965204+0000", 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965227+0000", 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2751e-05 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965247+0000", 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0404999999999999e-05 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971064+0000", 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058171619999999999 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971306+0000", 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024202800000000001 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984390+0000", 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013083734 2024-09-16T04:09:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984580+0000", 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000190101 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988107+0000", 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035270050000000002 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:70 3.cs0 3:32f692e4:::smithi20431790-24:head [append 0~393216,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.723927998000001, 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022625648000000002, 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 70 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984472+0000", 2024-09-16T04:09:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5770000000000001e-06 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985137+0000", 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066504699999999999 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985170+0000", 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2877999999999999e-05 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985193+0000", 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3014999999999999e-05 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988812+0000", 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003619583 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989134+0000", 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000321496 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992649+0000", 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003514994 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997670+0000", 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050209540000000002 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006922+0000", 2024-09-16T04:09:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092525839999999995 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007095+0000", 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017252000000000001 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:71 3.cs0 3:32f692e4:::smithi20431790-24:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.723167443999998, 2024-09-16T04:09:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024343912999999998, 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 71 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:09:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985232+0000", 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7710000000000001e-06 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985241+0000", 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985269+0000", 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7426000000000001e-05 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985286+0000", 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994404+0000", 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.009118279 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994605+0000", 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020087800000000001 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995926+0000", 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013212320000000001 2024-09-16T04:09:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998575+0000", 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026493300000000001 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009408+0000", 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010832965999999999 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009574+0000", 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165487 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:72 3.cs0 3:32f692e4:::smithi20431790-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.723087302000003, 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030489715000000001, 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 72 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:09:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985311+0000", 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.234e-06 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985319+0000", 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8110000000000003e-06 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985338+0000", 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9372e-05 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985354+0000", 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997327+0000", 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011973477999999999 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997539+0000", 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021212 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010366+0000", 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012826743 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010517+0000", 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150987 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015800+0000", 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052827170000000001 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:79 3.5s0 3:a92fec0c:::smithi20431790-27:head [append 0~442368,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.715179614, 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022443769999999998, 2024-09-16T04:09:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 79 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993221+0000", 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1939999999999998e-06 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994063+0000", 2024-09-16T04:09:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000842401 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994096+0000", 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2977e-05 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994117+0000", 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0632000000000002e-05 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994356+0000", 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023911000000000001 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994668+0000", 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031195700000000002 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998787+0000", 2024-09-16T04:09:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041189850000000004 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004001+0000", 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052138510000000002 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015531+0000", 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011530004 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015661+0000", 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013065900000000001 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:80 3.5s0 3:a92fec0c:::smithi20431790-27:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.714224790999999, 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022213561999999999, 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 80 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994174+0000", 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6190000000000001e-06 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994185+0000", 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1014e-05 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994208+0000", 2024-09-16T04:09:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2677999999999999e-05 2024-09-16T04:09:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994225+0000", 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7238e-05 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001985+0000", 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077595709999999998 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002157+0000", 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017256300000000001 2024-09-16T04:09:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003005+0000", 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084732500000000001 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004682+0000", 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016769899999999999 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016279+0000", 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011597303 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016386+0000", 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107261 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:81 3.5s0 3:a92fec0c:::smithi20431790-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.713909604000001, 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025428882, 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 81 2024-09-16T04:09:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994490+0000", 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994499+0000", 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6420000000000002e-06 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994529+0000", 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9405999999999999e-05 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994548+0000", 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9884000000000001e-05 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004211+0000", 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0096627850000000001 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004368+0000", 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015635099999999999 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016915+0000", 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012547063000000001 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.017089+0000", 2024-09-16T04:09:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017398399999999999 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.019917+0000", 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028279239999999999 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:302 3.cs0 3:374a82ae:::smithi20431790-44:head [append 0~475136] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.674323815000001, 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018500445000000001, 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 302 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034077+0000", 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2820000000000001e-06 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038863+0000", 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047866250000000001 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038897+0000", 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3225000000000001e-05 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038915+0000", 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8802000000000001e-05 2024-09-16T04:09:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.039123+0000", 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000207641 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.039359+0000", 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023585199999999999 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.041836+0000", 2024-09-16T04:09:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024766670000000001 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046352+0000", 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045161610000000003 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052364+0000", 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060125530000000003 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052574+0000", 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020963700000000001 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:306 3.cs0 3:374a82ae:::smithi20431790-44:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.660961729999997, 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026506662, 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 306 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047437+0000", 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047443+0000", 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.426e-06 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047463+0000", 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0193000000000001e-05 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047473+0000", 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3689999999999996e-06 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063090+0000", 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617617 2024-09-16T04:09:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063269+0000", 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017882900000000001 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064581+0000", 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001311986 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064808+0000", 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022633899999999999 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.073942+0000", 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091346529999999995 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:469 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.855518772, 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016802089999999999, 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 469 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852880+0000", 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852891+0000", 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1263e-05 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852917+0000", 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5423e-05 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852934+0000", 2024-09-16T04:09:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7062e-05 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859376+0000", 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064419810000000003 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859639+0000", 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026322599999999998 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861937+0000", 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022980449999999999 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864439+0000", 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025016249999999999 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869468+0000", 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050291470000000003 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869681+0000", 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285799999999999 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:509 3.cs0 3:3ee250f2:::smithi20431790-12:head [copy-from ver 8] snapc 10=[f] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:46.159683+0000", 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.548714499999999, 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025618154000000001, 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 509 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159683+0000", 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159683+0000", 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159685+0000", 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6809999999999998e-06 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159700+0000", 2024-09-16T04:09:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4446e-05 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159724+0000", 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3764000000000002e-05 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159737+0000", 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3078000000000001e-05 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159929+0000", 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019179900000000001 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.160106+0000", 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017779699999999999 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.176614+0000", 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016508088000000001 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179793+0000", 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00317827 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.185125+0000", 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053325910000000002 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.185301+0000", 2024-09-16T04:09:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017563999999999999 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:510 3.cs0 3:3ee250f2:::smithi20431790-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:46.159763+0000", 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.548633911, 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020020685, 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 510 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159763+0000", 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159763+0000", 2024-09-16T04:09:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159764+0000", 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5199999999999996e-07 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159776+0000", 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2218999999999999e-05 2024-09-16T04:09:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159787+0000", 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0463e-05 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159795+0000", 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4929999999999998e-06 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.160405+0000", 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000609375 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.160485+0000", 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9930000000000002e-05 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179211+0000", 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018726652999999999 2024-09-16T04:09:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179476+0000", 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026453400000000003 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179784+0000", 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030836600000000002 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:765 3.cs0 3:3ee250f2:::smithi20431790-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.270867+0000", 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.4375305169999999, 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017981079000000001, 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 765 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270867+0000", 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270867+0000", 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270868+0000", 2024-09-16T04:09:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5000000000000001e-07 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270873+0000", 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2499999999999997e-06 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270902+0000", 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9209000000000001e-05 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270923+0000", 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0469e-05 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.282951+0000", 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012028143999999999 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.283184+0000", 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233637 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.285737+0000", 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025525959999999999 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.285975+0000", 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000237913 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.288848+0000", 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028729110000000001 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:944 3.5s0 3:a92fec0c:::smithi20431790-27:head [setxattr _header (57) in=7b] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.670182+0000", 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.038215011, 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019828129, 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 944 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670182+0000", 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670182+0000", 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670183+0000", 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.64e-07 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670199+0000", 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5823000000000001e-05 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670221+0000", 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2087e-05 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670231+0000", 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0237e-05 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.674015+0000", 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037832159999999998 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.674125+0000", 2024-09-16T04:09:02.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110661 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.674666+0000", 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054037200000000001 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.675673+0000", 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010077930000000001 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.689888+0000", 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014214485000000001 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.690010+0000", 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012249099999999999 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:945 3.5s0 3:a92fec0c:::smithi20431790-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:02.822 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.670292+0000", 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.03810521, 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023379965999999999, 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 945 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670292+0000", 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670292+0000", 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670293+0000", 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8700000000000005e-07 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670296+0000", 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6720000000000002e-06 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670309+0000", 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2235000000000001e-05 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670316+0000", 2024-09-16T04:09:02.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6690000000000006e-06 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.675406+0000", 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050893220000000003 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.675642+0000", 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023648300000000001 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.690685+0000", 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015042971 2024-09-16T04:09:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.690799+0000", 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114239 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.693672+0000", 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002872688 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:02.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:02.828 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:348: finishing write tid 2 to smithi20431790-29 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:358: finishing write tid 1 to smithi20431790-46 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:361: finishing write tid 1 to smithi20431790-27 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 5 v 196 (ObjNum 88 snap 11 seq_num 88) dirty exists 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:358: finishing write tid 2 to smithi20431790-46 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:355: finishing rollback tid 0 to smithi20431790-30 2024-09-16T04:09:02.829 INFO:tasks.rados.rados.0.smithi204.stdout:354: finishing write tid 2 to smithi20431790-7 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:358: finishing write tid 3 to smithi20431790-46 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:358: oid 46 updating version 0 to 59 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:358: oid 46 updating version 59 to 60 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 46 v 60 (ObjNum 148 snap 23 seq_num 148) dirty exists 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:358: left oid 46 (ObjNum 148 snap 23 seq_num 148) 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:354: finishing write tid 3 to smithi20431790-7 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:354: oid 7 updating version 0 to 65 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:354: oid 7 version 65 is already newer than 64 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 7 v 65 (ObjNum 146 snap 23 seq_num 146) dirty exists 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:354: left oid 7 (ObjNum 146 snap 23 seq_num 146) 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:357: finishing write tid 1 to smithi20431790-1 2024-09-16T04:09:02.830 INFO:tasks.rados.rados.0.smithi204.stdout:348: finishing write tid 3 to smithi20431790-29 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:348: oid 29 updating version 0 to 195 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:348: oid 29 version 195 is already newer than 194 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 29 v 195 (ObjNum 145 snap 23 seq_num 145) dirty exists 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:348: left oid 29 (ObjNum 145 snap 23 seq_num 145) 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:363: finishing write tid 1 to smithi20431790-25 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:355: finishing rollback tid 1 to smithi20431790-30 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:363: finishing write tid 2 to smithi20431790-25 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:357: finishing write tid 2 to smithi20431790-1 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:361: finishing write tid 2 to smithi20431790-27 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:363: finishing write tid 3 to smithi20431790-25 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:363: oid 25 updating version 0 to 67 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:363: oid 25 updating version 67 to 68 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 25 v 68 (ObjNum 150 snap 23 seq_num 150) dirty exists 2024-09-16T04:09:02.831 INFO:tasks.rados.rados.0.smithi204.stdout:363: left oid 25 (ObjNum 150 snap 23 seq_num 150) 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:361: finishing write tid 3 to smithi20431790-27 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:361: oid 27 updating version 0 to 49 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:361: oid 27 updating version 49 to 50 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 27 v 50 (ObjNum 149 snap 23 seq_num 149) dirty exists 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:361: left oid 27 (ObjNum 149 snap 23 seq_num 149) 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:349: finishing copy_from racing read to smithi20431790-45 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:355: finishing rollback tid 2 to smithi20431790-30 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 30 v 199 (ObjNum 114 snap 21 seq_num 114) dirty exists 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:349: finishing copy_from to smithi20431790-45 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 45 v 149 (ObjNum 140 snap 23 seq_num 140) dirty exists 2024-09-16T04:09:02.832 INFO:tasks.rados.rados.0.smithi204.stdout:359: expect (ObjNum 89 snap 11 seq_num 89) 2024-09-16T04:09:02.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:09:02.833 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:02.826+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:02.894 INFO:tasks.rados.rados.0.smithi204.stdout:357: finishing write tid 3 to smithi20431790-1 2024-09-16T04:09:02.894 INFO:tasks.rados.rados.0.smithi204.stdout:357: oid 1 updating version 0 to 151 2024-09-16T04:09:02.894 INFO:tasks.rados.rados.0.smithi204.stdout:357: oid 1 updating version 151 to 152 2024-09-16T04:09:02.894 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 1 v 152 (ObjNum 147 snap 23 seq_num 147) dirty exists 2024-09-16T04:09:02.894 INFO:tasks.rados.rados.0.smithi204.stdout:357: left oid 1 (ObjNum 147 snap 23 seq_num 147) 2024-09-16T04:09:02.899 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-16T04:09:02.899 INFO:tasks.rados.rados.0.smithi204.stdout:348: done (11 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:349: done (10 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:352: done (9 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:354: done (8 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:355: done (7 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:357: done (6 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:358: done (5 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:359: done (4 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:360: done (3 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:361: done (2 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:363: done (1 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:364: done (0 left) 2024-09-16T04:09:02.900 INFO:tasks.rados.rados.0.smithi204.stdout:365: snap_create 2024-09-16T04:09:02.900 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-16T04:09:02.901 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T04:09:02.901 INFO:tasks.thrashosds.thrasher:Removing osd 8, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] 2024-09-16T04:09:02.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 8 2024-09-16T04:09:02.929 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:02.926+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:03.009 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:03.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:03.009 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:03.009 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:03.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:09:03.031 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:03.026+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:03.132 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:03.130+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:03.151 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:03.151 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:03.151 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:03.152 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:03.152 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:03.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:09:03.221 INFO:tasks.ceph.mon.b.smithi050.stderr:2024-09-16T04:09:03.215+0000 7f36ccf76640 -1 mon.b@1(leader).osd e80 definitely_dead 0 2024-09-16T04:09:03.233 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:09:03.227+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:09:03.296 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.354453821999996, 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063652539999999999, 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938469+0000", 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2699999999999998e-07 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938635+0000", 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016581300000000001 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938684+0000", 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9576000000000001e-05 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938883+0000", 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000199173 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939095+0000", 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000211246 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939119+0000", 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4357000000000001e-05 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944738+0000", 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056193900000000001 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944833+0000", 2024-09-16T04:09:03.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4871999999999996e-05 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.353914500000002, 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047666380000000001, 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939008+0000", 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.13e-07 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939093+0000", 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5012999999999994e-05 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939129+0000", 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5636999999999998e-05 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939152+0000", 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3745000000000001e-05 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939447+0000", 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029490799999999998 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939469+0000", 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1848000000000002e-05 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943713+0000", 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042438789999999999 2024-09-16T04:09:03.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943774+0000", 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0995000000000001e-05 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.353834517000003, 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058140029999999999, 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939089+0000", 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5570000000000001e-06 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939159+0000", 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0069999999999998e-05 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939189+0000", 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9971000000000002e-05 2024-09-16T04:09:03.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939212+0000", 2024-09-16T04:09:03.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3088999999999999e-05 2024-09-16T04:09:03.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941350+0000", 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021383169999999998 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941374+0000", 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3742000000000001e-05 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944842+0000", 2024-09-16T04:09:03.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034683349999999999 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944901+0000", 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8922000000000003e-05 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:09:03.310 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.350774379999997, 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050280460000000004, 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:09:03.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942149+0000", 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-06 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942191+0000", 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1461999999999997e-05 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942224+0000", 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3181e-05 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942254+0000", 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0151e-05 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942467+0000", 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212862 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942490+0000", 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3227999999999999e-05 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947072+0000", 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00458203 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947176+0000", 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010343799999999999 2024-09-16T04:09:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=8, reqid=client.4631.0:61, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.315459574999998, 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063833630000000004, 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977464+0000", 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.531e-06 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977708+0000", 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024464000000000002 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977740+0000", 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1711000000000002e-05 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977762+0000", 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399e-05 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977934+0000", 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000172654 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977956+0000", 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1435000000000001e-05 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983751+0000", 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057949120000000002 2024-09-16T04:09:03.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983846+0000", 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5081000000000007e-05 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=9, reqid=client.4631.0:62, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.314669463999998, 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056761249999999997, 2024-09-16T04:09:03.319 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978254+0000", 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.488e-06 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978292+0000", 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7880000000000003e-05 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978321+0000", 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9023e-05 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978340+0000", 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9524000000000001e-05 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979207+0000", 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00086708800000000002 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979243+0000", 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5457000000000003e-05 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983860+0000", 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046170930000000001 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983929+0000", 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8571999999999993e-05 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=6, reqid=client.4631.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:09:03.323 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.308893662000003, 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011901461, 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984031+0000", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3429999999999998e-06 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984058+0000", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7029000000000002e-05 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984089+0000", 2024-09-16T04:09:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1016999999999998e-05 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984109+0000", 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0842000000000001e-05 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984406+0000", 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029609200000000002 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984434+0000", 2024-09-16T04:09:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8918e-05 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995793+0000", 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011358052 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995930+0000", 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013716800000000001 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.306503409999998, 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095992419999999992, 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986420+0000", 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.934e-06 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987321+0000", 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090024099999999998 2024-09-16T04:09:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987354+0000", 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3154999999999997e-05 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987376+0000", 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1923999999999999e-05 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987514+0000", 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013814799999999999 2024-09-16T04:09:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987534+0000", 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9873000000000001e-05 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995938+0000", 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084043529999999998 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996018+0000", 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9614e-05 2024-09-16T04:09:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.30287594, 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059765189999999996, 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990048+0000", 2024-09-16T04:09:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8509999999999999e-06 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990075+0000", 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7158e-05 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990106+0000", 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1080000000000001e-05 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990136+0000", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9901000000000001e-05 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990290+0000", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015433800000000001 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990314+0000", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3421000000000002e-05 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995910+0000", 2024-09-16T04:09:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055967500000000002 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996022+0000", 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011202 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 38/31 ECSubWrite(tid=32, reqid=client.4631.0:186, at_version=38'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.318994240000002, 2024-09-16T04:09:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048151569999999996, 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6599999999999996e-07 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973995+0000", 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6209000000000003e-05 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974069+0000", 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4597000000000004e-05 2024-09-16T04:09:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974094+0000", 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4532000000000002e-05 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974684+0000", 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058996600000000004 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974697+0000", 2024-09-16T04:09:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3689000000000001e-05 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.977292+0000", 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025942180000000001 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.978743+0000", 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014512800000000001 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.439091327, 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074691879999999999, 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853882+0000", 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0699999999999999e-05 2024-09-16T04:09:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853914+0000", 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1569000000000002e-05 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853935+0000", 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1818e-05 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.854184+0000", 2024-09-16T04:09:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024827300000000003 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.854210+0000", 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5885e-05 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.861170+0000", 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069599529999999996 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.861300+0000", 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013018599999999999 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.0s2 53/31 ECSubWrite(tid=66, reqid=client.4631.0:413, at_version=53'27, trim_to=0'0, roll_forward_to=52'25))", 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.223214554999998, 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053210929999999998, 2024-09-16T04:09:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069708+0000", 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0699999999999997e-07 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070037+0000", 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032869699999999997 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070073+0000", 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6288000000000002e-05 2024-09-16T04:09:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070098+0000", 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5075999999999998e-05 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070299+0000", 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020064 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070326+0000", 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7291999999999999e-05 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.074948+0000", 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046217669999999997 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.075028+0000", 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0725999999999999e-05 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=104, reqid=client.4631.0:475, at_version=59'34, trim_to=0'0, roll_forward_to=52'32))", 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.432264870000001, 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056955520000000004, 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860658+0000", 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860757+0000", 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9046e-05 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860802+0000", 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4814999999999997e-05 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860829+0000", 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7495e-05 2024-09-16T04:09:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861131+0000", 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030179099999999998 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861164+0000", 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3538999999999999e-05 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866258+0000", 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050931470000000001 2024-09-16T04:09:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866353+0000", 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5025999999999994e-05 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 64/31 ECSubWrite(tid=137, reqid=osd.13.0:137, at_version=64'17, trim_to=0'0, roll_forward_to=63'15))", 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:46.905385+0000", 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.387536568000002, 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050199229999999999, 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905385+0000", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905385+0000", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905386+0000", 2024-09-16T04:09:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.39e-07 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905412+0000", 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6239999999999999e-05 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905437+0000", 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4569000000000001e-05 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905450+0000", 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.324e-05 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905655+0000", 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204933 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905670+0000", 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4859e-05 2024-09-16T04:09:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.910346+0000", 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004676202 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.910405+0000", 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9441000000000002e-05 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 73/31 ECSubWrite(tid=174, reqid=client.4631.0:740, at_version=73'20, trim_to=0'0, roll_forward_to=73'18))", 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:56.214251+0000", 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.0786707760000001, 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007100164, 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.214251+0000", 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.214251+0000", 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.214254+0000", 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-06 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218060+0000", 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038055710000000002 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218116+0000", 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6331e-05 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218142+0000", 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5675999999999999e-05 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218315+0000", 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017352599999999999 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218342+0000", 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7064999999999999e-05 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.221262+0000", 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00292026 2024-09-16T04:09:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.221351+0000", 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8861000000000002e-05 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 74/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=74'59, trim_to=0'0, roll_forward_to=73'57))", 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.4337253739999998, 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052387400000000004, 2024-09-16T04:09:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4300000000000002e-07 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859264+0000", 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6354999999999997e-05 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859308+0000", 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4656000000000001e-05 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859334+0000", 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5301999999999999e-05 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.861269+0000", 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019350179999999999 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.861295+0000", 2024-09-16T04:09:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6228999999999999e-05 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.864335+0000", 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030400399999999999 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.864435+0000", 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010039699999999999 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 75/31 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=75'61, trim_to=0'0, roll_forward_to=74'59))", 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.869673+0000", 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.4232491190000003, 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056653789999999999, 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869673+0000", 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869673+0000", 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869674+0000", 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6300000000000004e-07 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869731+0000", 2024-09-16T04:09:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7802e-05 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869766+0000", 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5065999999999999e-05 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869790+0000", 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3125999999999998e-05 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869971+0000", 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000181318 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869998+0000", 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7226e-05 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875246+0000", 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052477340000000004 2024-09-16T04:09:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875338+0000", 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2343999999999995e-05 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.0s2 75/31 ECSubWrite(tid=107, reqid=osd.12.0:107, at_version=75'47, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.4207352289999999, 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005798826, 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5400000000000001e-07 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872248+0000", 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0988e-05 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872296+0000", 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8278000000000001e-05 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872322+0000", 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5916999999999999e-05 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872497+0000", 2024-09-16T04:09:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017428100000000001 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872523+0000", 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6789000000000001e-05 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.877867+0000", 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053438859999999999 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.877985+0000", 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118133 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 75/31 ECSubWrite(tid=192, reqid=osd.13.0:190, at_version=0'0, trim_to=0'0, roll_forward_to=75'61))", 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.882182+0000", 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.4107395589999996, 2024-09-16T04:09:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050015349999999997, 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882182+0000", 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882182+0000", 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882185+0000", 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.317e-06 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882214+0000", 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9819e-05 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882259+0000", 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4882000000000002e-05 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882283+0000", 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3223000000000001e-05 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882807+0000", 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052451600000000004 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882834+0000", 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6704999999999999e-05 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.887084+0000", 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042498060000000001 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.887184+0000", 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010026699999999999 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 76/31 ECSubWrite(tid=139, reqid=osd.5.0:139, at_version=76'24, trim_to=0'0, roll_forward_to=75'22))", 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:58.894693+0000", 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.398228918, 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051752020000000003, 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894693+0000", 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894693+0000", 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894694+0000", 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:09:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894751+0000", 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7049000000000002e-05 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894784+0000", 2024-09-16T04:09:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3815000000000001e-05 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894807+0000", 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2629999999999998e-05 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894985+0000", 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017747499999999999 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.895011+0000", 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6843e-05 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.899769+0000", 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00475772 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.899868+0000", 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9077e-05 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.387 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:03.388 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:09:03.389 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:03.386+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:03.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2024-09-16T04:09:03.486+0000 7f0b597be640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26380) UID: 0 2024-09-16T04:09:03.521 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:03.521 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:03.521 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:03.522 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:03.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:09:03.590 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:03.590+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:03.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T04:09:03.656 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:03.657 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:03.657 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:03.657 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:03.657 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:03.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:09:03.691 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:03.690+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:03.752 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:09:03.753 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:09:03.773 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:09:03.773 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:09:03.792 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:09:03.787+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:09:03.793 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:03.794 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:03.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:03.794 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:03.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.794 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:9 3.as0 3:52d8912d:::smithi20431790-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:03.794 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.857332247999999, 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.032735913999999998, 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.795 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 9 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934092+0000", 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3170000000000001e-06 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934099+0000", 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.37e-06 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934121+0000", 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2124999999999999e-05 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934137+0000", 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6464999999999999e-05 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941032+0000", 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068944719999999996 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941265+0000", 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233105 2024-09-16T04:09:03.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952818+0000", 2024-09-16T04:09:03.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011552529000000001 2024-09-16T04:09:03.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.953039+0000", 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221089 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.966827+0000", 2024-09-16T04:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013788442 2024-09-16T04:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:20 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.852821601000002, 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020600382, 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 20 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938604+0000", 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9659999999999999e-06 2024-09-16T04:09:03.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938616+0000", 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1992e-05 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938643+0000", 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7447999999999999e-05 2024-09-16T04:09:03.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9269000000000001e-05 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941338+0000", 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002675242 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941576+0000", 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023854 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943570+0000", 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019934800000000002 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949041+0000", 2024-09-16T04:09:03.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005471722 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958969+0000", 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099272460000000007 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959202+0000", 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233477 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:21 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.852713659999999, 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028407564999999999, 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 21 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.810 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938711+0000", 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4330000000000001e-06 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938719+0000", 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3189999999999995e-06 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938743+0000", 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3645000000000001e-05 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938782+0000", 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9013000000000001e-05 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944592+0000", 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005810267 2024-09-16T04:09:03.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944817+0000", 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000224904 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960092+0000", 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015274846 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960315+0000", 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223095 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967117+0000", 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068020429999999998 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:58 3.as0 3:57bc9072:::smithi20431790-20:head [append 0~327680,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.815 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.818711061000002, 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023641881999999999, 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 58 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.816 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972715+0000", 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1310000000000002e-06 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973401+0000", 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068536200000000002 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973436+0000", 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4777000000000003e-05 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973457+0000", 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1047e-05 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973758+0000", 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000301716 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974093+0000", 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033437899999999999 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976226+0000", 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021329019999999999 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991758+0000", 2024-09-16T04:09:03.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015532035 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044259850000000003 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996354+0000", 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017054799999999999 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:59 3.as0 3:57bc9072:::smithi20431790-20:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.817915110999998, 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023229295, 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 59 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973510+0000", 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973519+0000", 2024-09-16T04:09:03.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9449999999999999e-06 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973678+0000", 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158815 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973702+0000", 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.461e-05 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977799+0000", 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040967520000000004 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978040+0000", 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024069299999999999 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979318+0000", 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001278164 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991761+0000", 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012442844999999999 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996561+0000", 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048005419999999997 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996738+0000", 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017617199999999999 2024-09-16T04:09:03.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:60 3.as0 3:57bc9072:::smithi20431790-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.817689446999999, 2024-09-16T04:09:03.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034426401000000002, 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 60 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973736+0000", 2024-09-16T04:09:03.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-06 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973746+0000", 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0056e-05 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973770+0000", 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3966999999999999e-05 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973785+0000", 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5512999999999999e-05 2024-09-16T04:09:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979953+0000", 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061678890000000002 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980244+0000", 2024-09-16T04:09:03.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029044900000000002 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996914+0000", 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016670404999999999 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997079+0000", 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165126 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008160+0000", 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011081036000000001 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:64 3.as0 3:5581c6e4:::smithi20431790-22:head [append 0~360448,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.812968619000003, 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024425922999999999, 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 64 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978458+0000", 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7429999999999998e-06 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979197+0000", 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073908700000000003 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979227+0000", 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0793999999999997e-05 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979247+0000", 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0078999999999999e-05 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980478+0000", 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012303170000000001 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981002+0000", 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052460899999999999 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990256+0000", 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092540160000000003 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002501+0000", 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012244649 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002743+0000", 2024-09-16T04:09:03.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024201600000000001 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002881+0000", 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137613 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:65 3.as0 3:5581c6e4:::smithi20431790-22:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.812140882000001, 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027732105, 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 65 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979284+0000", 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.711e-06 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979382+0000", 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8177999999999994e-05 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979409+0000", 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6435e-05 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979459+0000", 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0192999999999999e-05 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993281+0000", 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013822302 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993476+0000", 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019474100000000001 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994583+0000", 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001106473 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003469+0000", 2024-09-16T04:09:03.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088860840000000007 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006865+0000", 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033959749999999999 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007015+0000", 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150013 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:66 3.as0 3:5581c6e4:::smithi20431790-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.811936148000001, 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.035359943999999997, 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 66 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979489+0000", 2024-09-16T04:09:03.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5999999999999999e-06 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979496+0000", 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0820000000000001e-06 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979516+0000", 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9779000000000002e-05 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979530+0000", 2024-09-16T04:09:03.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4198e-05 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994979+0000", 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015449176 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995185+0000", 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000206391 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008423+0000", 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013237844 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008619+0000", 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195582 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.014847+0000", 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062282919999999999 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:67 3.ds0 3:bc48267e:::smithi20431790-23:head [append 0~376832,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.809648533999997, 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020232841000000001, 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 67 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981785+0000", 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982754+0000", 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096953899999999995 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982787+0000", 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3216999999999997e-05 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982807+0000", 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9304e-05 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983165+0000", 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035800399999999998 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983490+0000", 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032504399999999997 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985908+0000", 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024180780000000002 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994386+0000", 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084781360000000007 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001861+0000", 2024-09-16T04:09:03.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074755220000000001 2024-09-16T04:09:03.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002008+0000", 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014632299999999999 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:69 3.ds0 3:bc48267e:::smithi20431790-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.808477166000003, 2024-09-16T04:09:03.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028842145999999999, 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 69 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982948+0000", 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-06 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982989+0000", 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1464999999999997e-05 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983013+0000", 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3703999999999999e-05 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983029+0000", 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5843999999999999e-05 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990775+0000", 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077465149999999998 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991025+0000", 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024982599999999998 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003046+0000", 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012021118000000001 2024-09-16T04:09:03.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003451+0000", 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040476500000000002 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011788+0000", 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008337555 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.868 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:308 3.as0 3:57bc9072:::smithi20431790-20:head [copy-from ver 2] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 36.746897193000002, 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020181012000000002, 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 308 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044530+0000", 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8260000000000003e-06 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044545+0000", 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4922999999999999e-05 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044581+0000", 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5763999999999998e-05 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044602+0000", 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1662e-05 2024-09-16T04:09:03.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044981+0000", 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378907 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.045271+0000", 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000289945 2024-09-16T04:09:03.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.058303+0000", 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013031612999999999 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061763+0000", 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034603099999999999 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064481+0000", 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002717849 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064707+0000", 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022621300000000001 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:470 3.fs0 3:f2191a5d:::smithi20431790-25:head [copy-from ver 0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.938689139000001, 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020390709999999999, 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.875 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 470 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852737+0000", 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2370000000000001e-06 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852753+0000", 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5056e-05 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852786+0000", 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3105000000000002e-05 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852802+0000", 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852975+0000", 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017205200000000001 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852988+0000", 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.324e-05 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859023+0000", 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060348279999999999 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859276+0000", 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025340600000000002 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873125+0000", 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013848973000000001 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:471 3.fs0 3:f2191a5d:::smithi20431790-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.938581503000002, 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021425564000000001, 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 471 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852843+0000", 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5000000000000001e-07 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852848+0000", 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9400000000000001e-06 2024-09-16T04:09:03.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852864+0000", 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6606e-05 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852874+0000", 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9590000000000007e-06 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853159+0000", 2024-09-16T04:09:03.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028422899999999999 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853179+0000", 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0692000000000001e-05 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859762+0000", 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065823050000000001 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859940+0000", 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017856600000000001 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873687+0000", 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013747120999999999 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873971+0000", 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028401799999999998 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874267+0000", 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029617800000000002 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:472 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:03.887 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.938476053999999, 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022526906999999999, 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 472 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852949+0000", 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.753e-06 2024-09-16T04:09:03.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852957+0000", 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7100000000000007e-06 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852982+0000", 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4745000000000001e-05 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852996+0000", 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3963e-05 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853399+0000", 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040381400000000001 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853420+0000", 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0525000000000001e-05 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860064+0000", 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066444 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860233+0000", 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000168486 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.862013+0000", 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001780626 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874451+0000", 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012437521 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.875343+0000", 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089236299999999997 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.875474+0000", 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131001 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:473 3.fs0 3:fb02b556:::smithi20431790-7:head [rollback f] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.938411342999999, 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023677446000000001, 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 473 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853013+0000", 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.23e-07 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853017+0000", 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5059999999999997e-06 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853029+0000", 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1653e-05 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853037+0000", 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6469999999999998e-06 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853512+0000", 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000475413 2024-09-16T04:09:03.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853522+0000", 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864892+0000", 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01137 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.865279+0000", 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000386857 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.868280+0000", 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030007079999999999 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874454+0000", 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006174489 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.876467+0000", 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020123160000000001 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.876689+0000", 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022274799999999999 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:474 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:09:03.900 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.938347223000001, 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024572546000000001, 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 474 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853077+0000", 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2729999999999999e-06 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853084+0000", 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9999999999999999e-06 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853106+0000", 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1063000000000001e-05 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853121+0000", 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5862000000000002e-05 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853593+0000", 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047153100000000002 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853603+0000", 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0402e-05 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869443+0000", 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015839776999999999 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869707+0000", 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026354599999999997 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.872401+0000", 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026945939999999998 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874705+0000", 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023035640000000001 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.877404+0000", 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026990410000000001 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.877649+0000", 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024489299999999999 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.906 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:758 3.fs0 3:f676a78d:::smithi20431790-34:head [copy-from ver 46] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.011927+0000", 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.7794959659999998, 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021583906999999999, 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 758 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011927+0000", 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011927+0000", 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011930+0000", 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9799999999999998e-06 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011944+0000", 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3739e-05 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011979+0000", 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5235999999999999e-05 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011995+0000", 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.517e-05 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.012170+0000", 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017525200000000001 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.012464+0000", 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029427499999999998 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.025757+0000", 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01329262 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.030738+0000", 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049816879999999997 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.033356+0000", 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026174879999999998 2024-09-16T04:09:03.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.033511+0000", 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015545899999999999 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:924 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (56) in=7b] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.657034+0000", 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.134388897, 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027035429, 2024-09-16T04:09:03.912 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 924 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657034+0000", 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657034+0000", 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657036+0000", 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7990000000000001e-06 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657044+0000", 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7330000000000003e-06 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657068+0000", 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4471e-05 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657086+0000", 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7771999999999999e-05 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.662868+0000", 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057815590000000004 2024-09-16T04:09:03.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.663153+0000", 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028562599999999998 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.664339+0000", 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001185071 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.666502+0000", 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021637589999999999 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.683706+0000", 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017204119 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.684070+0000", 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036351999999999999 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.917 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:925 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.657111+0000", 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.1343119580000001, 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.029622048000000002, 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:03.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 925 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657111+0000", 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657111+0000", 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:03.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657113+0000", 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3400000000000001e-06 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657120+0000", 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2699999999999999e-06 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657142+0000", 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2095000000000001e-05 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657158+0000", 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5631e-05 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.664933+0000", 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077752000000000003 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.665153+0000", 2024-09-16T04:09:03.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022049099999999999 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.684157+0000", 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019003596000000001 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.684245+0000", 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8301999999999996e-05 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:03.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.686733+0000", 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024881230000000001 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:03.924 INFO:tasks.rados.rados.0.smithi204.stdout:365: done (0 left) 2024-09-16T04:09:03.924 INFO:tasks.rados.rados.0.smithi204.stdout:366: snap_remove snap 24 2024-09-16T04:09:03.924 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:09:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:09:03.925 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:09:03.926 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:09:03.926 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:09:03.926 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:09:03.927 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:09:03.927 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:09:03.927 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:09:03.928 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:09:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:09:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:marked out osd.8. 2024-09-16T04:09:03.928 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:09:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:09:03.929 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:09:03.919+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:09:03.934 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:09:03.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:09:03.958 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:09:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:09:03.977 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:09:03.977 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:09:04.000 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:09:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:09:04.022 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:09:04.022 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:09:04.025 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:04.019+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:04.046 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:09:04.047 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:09:04.059 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.059 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:09:04.069+0000 7f64f27fc640 0 -- 172.21.15.32:0/1024435239 >> [v2:172.21.15.196:6824/3322576165,v1:172.21.15.196:6825/3322576165] conn(0x7f64f4221990 msgr2=0x7f64f4223d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:09:04.070 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:09:04.071 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:09:04.074 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:09:04.094 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:09:04.094 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:09:04.126 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:09:04.119+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:09:04.198 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.198 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:09:04.227 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:09:04.225+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:09:04.328 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:09:04.325+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:09:04.336 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.336 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.350 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:09:04.429 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:09:04.423+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:09:04.474 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.474 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.488 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:09:04.530 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-16T04:09:04.527+0000 7fdc8c339640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26260) UID: 0 2024-09-16T04:09:04.610 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.610 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:09:04.631 INFO:tasks.ceph.osd.9.smithi050.stderr:2024-09-16T04:09:04.627+0000 7f684a2df640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 26264) UID: 0 2024-09-16T04:09:04.732 INFO:tasks.ceph.osd.8.smithi032.stderr:2024-09-16T04:09:04.729+0000 7f7e99e89640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 26366) UID: 0 2024-09-16T04:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.765 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:09:04.833 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:04.831+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:04.855 INFO:tasks.rados.rados.0.smithi204.stdout:366: done (0 left) 2024-09-16T04:09:04.855 INFO:tasks.rados.rados.0.smithi204.stdout:367: read oid 4 snap 23 2024-09-16T04:09:04.855 INFO:tasks.rados.rados.0.smithi204.stdout:367: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:04.855 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 27 current snap is 25 2024-09-16T04:09:04.855 INFO:tasks.rados.rados.0.smithi204.stdout:368: seq_num 151 ranges {98304=131072} 2024-09-16T04:09:04.860 INFO:tasks.rados.rados.0.smithi204.stdout:368: writing smithi20431790-27 from 98304 to 229376 tid 1 2024-09-16T04:09:04.861 INFO:tasks.rados.rados.0.smithi204.stdout:369: read oid 40 snap -1 2024-09-16T04:09:04.861 INFO:tasks.rados.rados.0.smithi204.stdout:369: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:09:04.861 INFO:tasks.rados.rados.0.smithi204.stdout:370: delete oid 50 current snap is 25 2024-09-16T04:09:04.877 INFO:tasks.rados.rados.0.smithi204.stdout:370: done (3 left) 2024-09-16T04:09:04.877 INFO:tasks.rados.rados.0.smithi204.stdout:371: copy_from oid 37 from oid 20 current snap is 25 2024-09-16T04:09:04.878 INFO:tasks.rados.rados.0.smithi204.stdout:372: delete oid 2 current snap is 25 2024-09-16T04:09:04.878 INFO:tasks.rados.rados.0.smithi204.stdout:369: expect (ObjNum 26 snap 0 seq_num 26) 2024-09-16T04:09:04.896 INFO:tasks.rados.rados.0.smithi204.stdout:367: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:04.904 INFO:tasks.rados.rados.0.smithi204.stdout:368: finishing write tid 1 to smithi20431790-27 2024-09-16T04:09:04.904 INFO:tasks.rados.rados.0.smithi204.stdout:368: finishing write tid 2 to smithi20431790-27 2024-09-16T04:09:04.904 INFO:tasks.rados.rados.0.smithi204.stdout:371: finishing copy_from racing read to smithi20431790-37 2024-09-16T04:09:04.904 INFO:tasks.rados.rados.0.smithi204.stdout:371: finishing copy_from to smithi20431790-37 2024-09-16T04:09:04.904 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 37 v 79 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:09:04.906 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:04.906 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:04.907 INFO:tasks.rados.rados.0.smithi204.stdout:368: finishing write tid 3 to smithi20431790-27 2024-09-16T04:09:04.907 INFO:tasks.rados.rados.0.smithi204.stdout:368: oid 27 updating version 0 to 52 2024-09-16T04:09:04.907 INFO:tasks.rados.rados.0.smithi204.stdout:368: oid 27 version 52 is already newer than 51 2024-09-16T04:09:04.907 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 27 v 52 (ObjNum 151 snap 25 seq_num 151) dirty exists 2024-09-16T04:09:04.907 INFO:tasks.rados.rados.0.smithi204.stdout:368: left oid 27 (ObjNum 151 snap 25 seq_num 151) 2024-09-16T04:09:04.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:09:04.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-16T04:09:04.937 INFO:tasks.rados.rados.0.smithi204.stdout:367: done (4 left) 2024-09-16T04:09:04.937 INFO:tasks.rados.rados.0.smithi204.stdout:368: done (3 left) 2024-09-16T04:09:04.937 INFO:tasks.rados.rados.0.smithi204.stdout:369: done (2 left) 2024-09-16T04:09:04.937 INFO:tasks.rados.rados.0.smithi204.stdout:371: done (1 left) 2024-09-16T04:09:04.937 INFO:tasks.rados.rados.0.smithi204.stdout:372: done (0 left) 2024-09-16T04:09:04.937 INFO:tasks.rados.rados.0.smithi204.stdout:373: read oid 4 snap -1 2024-09-16T04:09:04.938 INFO:tasks.rados.rados.0.smithi204.stdout:373: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:04.938 INFO:tasks.rados.rados.0.smithi204.stdout:374: delete oid 24 current snap is 25 2024-09-16T04:09:04.944 INFO:tasks.rados.rados.0.smithi204.stdout:373: expect (ObjNum 15 snap 0 seq_num 15) 2024-09-16T04:09:04.953 INFO:tasks.rados.rados.0.smithi204.stdout:373: done (1 left) 2024-09-16T04:09:04.953 INFO:tasks.rados.rados.0.smithi204.stdout:374: done (0 left) 2024-09-16T04:09:04.953 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 28 current snap is 25 2024-09-16T04:09:04.953 INFO:tasks.rados.rados.0.smithi204.stdout:375: seq_num 155 ranges {1867776=212992} 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:375: writing smithi20431790-28 from 1867776 to 2080768 tid 1 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:376: rollback oid 14 current snap is 25 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 14 to 22 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:377: read oid 39 snap 23 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:377: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:378: rollback oid 6 current snap is 25 2024-09-16T04:09:04.973 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 6 to 22 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:379: read oid 46 snap -1 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:379: expect (ObjNum 148 snap 23 seq_num 148) 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:380: copy_from oid 10 from oid 31 current snap is 25 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:381: read oid 30 snap 23 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:381: expect (ObjNum 114 snap 21 seq_num 114) 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 36 current snap is 25 2024-09-16T04:09:04.974 INFO:tasks.rados.rados.0.smithi204.stdout:382: seq_num 156 ranges {4014080=229376} 2024-09-16T04:09:04.974 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:09:04.974+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:09:05.012 INFO:tasks.rados.rados.0.smithi204.stdout:382: writing smithi20431790-36 from 4014080 to 4243456 tid 1 2024-09-16T04:09:05.012 INFO:tasks.rados.rados.0.smithi204.stdout:383: setattr oid 25 current snap is 25 2024-09-16T04:09:05.012 INFO:tasks.rados.rados.0.smithi204.stdout:379: expect (ObjNum 148 snap 23 seq_num 148) 2024-09-16T04:09:05.026 INFO:tasks.rados.rados.0.smithi204.stdout:377: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-16T04:09:05.034 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-16T04:09:05.029+0000 7f11aff70640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26361) UID: 0 2024-09-16T04:09:05.048 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:05.048 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:05.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:09:05.069 INFO:tasks.rados.rados.0.smithi204.stdout:378: finishing rollback tid 0 to smithi20431790-6 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:375: finishing write tid 1 to smithi20431790-28 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:375: finishing write tid 2 to smithi20431790-28 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:378: finishing rollback tid 1 to smithi20431790-6 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:378: finishing rollback tid 2 to smithi20431790-6 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 6 v 110 (ObjNum 128 snap 22 seq_num 128) dirty exists 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:375: finishing write tid 3 to smithi20431790-28 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:375: oid 28 updating version 0 to 116 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:375: oid 28 updating version 116 to 117 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 28 v 117 (ObjNum 155 snap 25 seq_num 155) dirty exists 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:375: left oid 28 (ObjNum 155 snap 25 seq_num 155) 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:382: finishing write tid 1 to smithi20431790-36 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:382: finishing write tid 2 to smithi20431790-36 2024-09-16T04:09:05.070 INFO:tasks.rados.rados.0.smithi204.stdout:382: finishing write tid 3 to smithi20431790-36 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:382: oid 36 updating version 0 to 26 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:382: oid 36 version 26 is already newer than 25 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 36 v 26 (ObjNum 156 snap 25 seq_num 156) dirty exists 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:382: left oid 36 (ObjNum 156 snap 25 seq_num 156) 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:375: done (8 left) 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:377: done (7 left) 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:378: done (6 left) 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:379: done (5 left) 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:382: done (4 left) 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 6 current snap is 25 2024-09-16T04:09:05.071 INFO:tasks.rados.rados.0.smithi204.stdout:384: seq_num 157 ranges {4014080=245760} 2024-09-16T04:09:05.108 INFO:tasks.rados.rados.0.smithi204.stdout:384: writing smithi20431790-6 from 4014080 to 4259840 tid 1 2024-09-16T04:09:05.108 INFO:tasks.rados.rados.0.smithi204.stdout:385: read oid 23 snap 22 2024-09-16T04:09:05.108 INFO:tasks.rados.rados.0.smithi204.stdout:385: expect (ObjNum 124 snap 22 seq_num 124) 2024-09-16T04:09:05.108 INFO:tasks.rados.rados.0.smithi204.stdout:386: setattr oid 20 current snap is 25 2024-09-16T04:09:05.108 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 25 v 70 (ObjNum 150 snap 23 seq_num 150) dirty exists 2024-09-16T04:09:05.109 INFO:tasks.rados.rados.0.smithi204.stdout:383: done (6 left) 2024-09-16T04:09:05.110 INFO:tasks.rados.rados.0.smithi204.stdout:387: delete oid 21 current snap is 25 2024-09-16T04:09:05.120 INFO:tasks.rados.rados.0.smithi204.stdout:384: finishing write tid 1 to smithi20431790-6 2024-09-16T04:09:05.120 INFO:tasks.rados.rados.0.smithi204.stdout:384: finishing write tid 2 to smithi20431790-6 2024-09-16T04:09:05.122 INFO:tasks.rados.rados.0.smithi204.stdout:387: done (6 left) 2024-09-16T04:09:05.122 INFO:tasks.rados.rados.0.smithi204.stdout:388: copy_from oid 44 from oid 41 current snap is 25 2024-09-16T04:09:05.122 INFO:tasks.rados.rados.0.smithi204.stdout:389: read oid 27 snap -1 2024-09-16T04:09:05.122 INFO:tasks.rados.rados.0.smithi204.stdout:389: expect (ObjNum 151 snap 25 seq_num 151) 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:390: read oid 32 snap -1 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:390: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:391: read oid 28 snap -1 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:391: expect (ObjNum 155 snap 25 seq_num 155) 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:392: rollback oid 48 current snap is 25 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:rollback oid 48 to 22 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:append oid 15 current snap is 25 2024-09-16T04:09:05.123 INFO:tasks.rados.rados.0.smithi204.stdout:393: seq_num 159 ranges {5079040=278528} 2024-09-16T04:09:05.134 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:09:05.131+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:09:05.167 INFO:tasks.rados.rados.0.smithi204.stdout:393: writing smithi20431790-15 from 5079040 to 5357568 tid 1 2024-09-16T04:09:05.167 INFO:tasks.rados.rados.0.smithi204.stdout:394: read oid 3 snap 22 2024-09-16T04:09:05.168 INFO:tasks.rados.rados.0.smithi204.stdout:394: expect (ObjNum 118 snap 22 seq_num 118) 2024-09-16T04:09:05.168 INFO:tasks.rados.rados.0.smithi204.stdout:395: rmattr oid 49 current snap is 25 2024-09-16T04:09:05.168 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 20 v 81 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-16T04:09:05.168 INFO:tasks.rados.rados.0.smithi204.stdout:389: expect (ObjNum 151 snap 25 seq_num 151) 2024-09-16T04:09:05.179 INFO:tasks.rados.rados.0.smithi204.stdout:386: done (13 left) 2024-09-16T04:09:05.179 INFO:tasks.rados.rados.0.smithi204.stdout:389: done (12 left) 2024-09-16T04:09:05.179 INFO:tasks.rados.rados.0.smithi204.stdout:396: copy_from oid 11 from oid 38 current snap is 25 2024-09-16T04:09:05.179 INFO:tasks.rados.rados.0.smithi204.stdout:385: expect (ObjNum 124 snap 22 seq_num 124) 2024-09-16T04:09:05.235 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-16T04:09:05.234+0000 7f5c17d9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26382) UID: 0 2024-09-16T04:09:05.239 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:05.239 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:05.248 INFO:tasks.rados.rados.0.smithi204.stdout:384: finishing write tid 3 to smithi20431790-6 2024-09-16T04:09:05.248 INFO:tasks.rados.rados.0.smithi204.stdout:384: oid 6 updating version 0 to 112 2024-09-16T04:09:05.248 INFO:tasks.rados.rados.0.smithi204.stdout:384: oid 6 version 112 is already newer than 111 2024-09-16T04:09:05.248 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 6 v 112 (ObjNum 157 snap 25 seq_num 157) dirty exists 2024-09-16T04:09:05.248 INFO:tasks.rados.rados.0.smithi204.stdout:384: left oid 6 (ObjNum 157 snap 25 seq_num 157) 2024-09-16T04:09:05.248 INFO:tasks.rados.rados.0.smithi204.stdout:390: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-16T04:09:05.252 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:09:05.268 INFO:tasks.rados.rados.0.smithi204.stdout:391: expect (ObjNum 155 snap 25 seq_num 155) 2024-09-16T04:09:05.336 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:05.331+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:05.351 INFO:tasks.rados.rados.0.smithi204.stdout:392: finishing rollback tid 0 to smithi20431790-48 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:392: finishing rollback tid 1 to smithi20431790-48 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:392: finishing rollback tid 2 to smithi20431790-48 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 48 v 55 (ObjNum 113 snap 19 seq_num 113) dirty exists 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:388: finishing copy_from racing read to smithi20431790-44 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:388: finishing copy_from to smithi20431790-44 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 44 v 8 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:384: done (12 left) 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:385: done (11 left) 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:388: done (10 left) 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:390: done (9 left) 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:391: done (8 left) 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:392: done (7 left) 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:397: rmattr oid 19 current snap is 25 2024-09-16T04:09:05.352 INFO:tasks.rados.rados.0.smithi204.stdout:397: done (7 left) 2024-09-16T04:09:05.353 INFO:tasks.rados.rados.0.smithi204.stdout:398: setattr oid 8 current snap is 25 2024-09-16T04:09:05.353 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 49 v 156 (ObjNum 126 snap 22 seq_num 126) dirty exists 2024-09-16T04:09:05.353 INFO:tasks.rados.rados.0.smithi204.stdout:393: finishing write tid 1 to smithi20431790-15 2024-09-16T04:09:05.353 INFO:tasks.rados.rados.0.smithi204.stdout:393: finishing write tid 2 to smithi20431790-15 2024-09-16T04:09:05.353 INFO:tasks.rados.rados.0.smithi204.stdout:394: expect (ObjNum 118 snap 22 seq_num 118) 2024-09-16T04:09:05.414 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:05.415 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:05.429 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:09:05.429 INFO:tasks.rados.rados.0.smithi204.stdout:393: finishing write tid 3 to smithi20431790-15 2024-09-16T04:09:05.429 INFO:tasks.rados.rados.0.smithi204.stdout:393: oid 15 updating version 0 to 120 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:393: oid 15 version 120 is already newer than 119 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 15 v 120 (ObjNum 159 snap 25 seq_num 159) dirty exists 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:393: left oid 15 (ObjNum 159 snap 25 seq_num 159) 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:396: finishing copy_from racing read to smithi20431790-11 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:396: finishing copy_from to smithi20431790-11 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 11 v 44 (ObjNum 131 snap 23 seq_num 131) dirty exists 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:393: done (7 left) 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:394: done (6 left) 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:395: done (5 left) 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:396: done (4 left) 2024-09-16T04:09:05.430 INFO:tasks.rados.rados.0.smithi204.stdout:399: delete oid 16 current snap is 25 2024-09-16T04:09:05.437 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 8 v 158 (ObjNum 98 snap 15 seq_num 98) dirty exists 2024-09-16T04:09:05.438 INFO:tasks.rados.rados.0.smithi204.stdout:398: done (4 left) 2024-09-16T04:09:05.438 INFO:tasks.rados.rados.0.smithi204.stdout:399: done (3 left) 2024-09-16T04:09:05.438 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 3 2024-09-16T04:09:05.474 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:05.474+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:05.538 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:05.535+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:05.548 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:05.548 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:05.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:09:05.638 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:05.631+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:05.727 INFO:teuthology.orchestra.run.smithi196.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:05.727 INFO:teuthology.orchestra.run.smithi196.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:05.739 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:09:05.736+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:09:05.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:09:05.840 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:05.836+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:05.854 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-16T04:09:05.873 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:05.873 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:05.879 INFO:tasks.rados.rados.0.smithi204.stdout:376: finishing rollback tid 0 to smithi20431790-14 2024-09-16T04:09:05.889 INFO:tasks.rados.rados.0.smithi204.stdout:380: finishing copy_from racing read to smithi20431790-10 2024-09-16T04:09:05.889 INFO:tasks.rados.rados.0.smithi204.stdout:380: finishing copy_from to smithi20431790-10 2024-09-16T04:09:05.889 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 10 v 193 (ObjNum 81 snap 0 seq_num 1766878316) dirty exists 2024-09-16T04:09:05.889 INFO:tasks.rados.rados.0.smithi204.stdout:380: done (2 left) 2024-09-16T04:09:05.889 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 2 2024-09-16T04:09:05.890 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:09:05.906 INFO:tasks.rados.rados.0.smithi204.stdout:376: finishing rollback tid 1 to smithi20431790-14 2024-09-16T04:09:05.907 INFO:tasks.rados.rados.0.smithi204.stdout:376: finishing rollback tid 2 to smithi20431790-14 2024-09-16T04:09:05.907 INFO:tasks.rados.rados.0.smithi204.stdout:update_object_version oid 14 v 205 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-16T04:09:05.907 INFO:tasks.rados.rados.0.smithi204.stdout:376: done (1 left) 2024-09-16T04:09:05.907 INFO:tasks.rados.rados.0.smithi204.stdout: waiting on 1 2024-09-16T04:09:05.919 INFO:tasks.rados.rados.0.smithi204.stdout:381: expect (ObjNum 114 snap 21 seq_num 114) 2024-09-16T04:09:05.941 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-16T04:09:05.935+0000 7f5263c9b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26633) UID: 0 2024-09-16T04:09:05.974 INFO:tasks.rados.rados.0.smithi204.stdout:381: done (0 left) 2024-09-16T04:09:05.979 INFO:tasks.rados.rados.0.smithi204.stderr:0 errors. 2024-09-16T04:09:05.979 INFO:tasks.rados.rados.0.smithi204.stderr: 2024-09-16T04:09:05.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:09:06.008 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:06.009 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:06.023 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:09:06.042 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:06.042+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:06.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T04:09:06.170 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:06.168+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:06.188 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:06.189 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:06.203 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:09:06.259 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:06.255+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:06.259 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-16T04:09:06.260 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-16T04:09:06.281 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-16T04:09:06.281 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-16T04:09:06.302 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-16T04:09:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-16T04:09:06.312 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:06.312 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":83,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:09:05.845791+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:09:03.900078+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T04:08:00.056722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.98338127136230469,"average_primary_affinity":0.98000001907348633,"average_primary_affinity_weighted":0.98000001907348633}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T04:08:00.124851+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.98338127136230469,"average_primary_affinity":0.98000001907348633,"average_primary_affinity_weighted":0.98000001907348633}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-09-16T04:08:12.936611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":26,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":0.734100341796875,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.576665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.064220+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.340791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:00.147346+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.536144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.357839+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.487279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.732168+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-09-16T04:09:02.265781+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.459706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.824262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.026860+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.185603+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.138963+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:57.035135+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:07:56.542290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.b","osds":[10,6,11,15,2147483647,1,14]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":21,"length":1},{"begin":23,"length":1},{"begin":26,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:09:06.326 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-16T04:09:06.326 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-16T04:09:06.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:06.337 INFO:teuthology.orchestra.run.smithi204.stdout:ERROR: (22) Invalid argument 2024-09-16T04:09:06.337 INFO:teuthology.orchestra.run.smithi204.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-16T04:09:06.345 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:06.339+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:06.346 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-16T04:09:06.346 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-16T04:09:06.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:09:06.369 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-16T04:09:06.370 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-16T04:09:06.392 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-16T04:09:06.393 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-16T04:09:06.417 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-16T04:09:06.417 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-16T04:09:06.439 INFO:teuthology.orchestra.run.smithi032.stdout:osd.8: {} 2024-09-16T04:09:06.439 INFO:teuthology.orchestra.run.smithi032.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-16T04:09:06.446 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:06.446+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:06.463 INFO:teuthology.orchestra.run.smithi032.stdout:osd.9: {} 2024-09-16T04:09:06.463 INFO:teuthology.orchestra.run.smithi032.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-16T04:09:06.491 INFO:teuthology.orchestra.run.smithi032.stdout:osd.10: {} 2024-09-16T04:09:06.491 INFO:teuthology.orchestra.run.smithi032.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-16T04:09:06.514 INFO:teuthology.orchestra.run.smithi032.stdout:osd.11: {} 2024-09-16T04:09:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-16T04:09:06.519 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:06.520 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:06.520 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:06.520 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:06.520 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:06.534 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:09:06.536 INFO:teuthology.orchestra.run.smithi032.stdout:osd.12: {} 2024-09-16T04:09:06.536 INFO:teuthology.orchestra.run.smithi032.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-16T04:09:06.546 INFO:tasks.ceph.osd.5.smithi050.stderr:2024-09-16T04:09:06.539+0000 7fa4a5671640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26262) UID: 0 2024-09-16T04:09:06.560 INFO:teuthology.orchestra.run.smithi032.stdout:osd.13: {} 2024-09-16T04:09:06.560 INFO:teuthology.orchestra.run.smithi032.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-16T04:09:06.584 INFO:teuthology.orchestra.run.smithi032.stdout:osd.14: {} 2024-09-16T04:09:06.584 INFO:teuthology.orchestra.run.smithi032.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-16T04:09:06.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:09:06.580+0000 7f22c0859640 0 -- 172.21.15.32:0/1232414923 >> [v2:172.21.15.204:6802/4287478944,v1:172.21.15.204:6803/4287478944] conn(0x7f22bc226540 msgr2=0x7f22bc228930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T04:09:06.608 INFO:teuthology.orchestra.run.smithi032.stdout:osd.15: {} 2024-09-16T04:09:06.608 INFO:teuthology.orchestra.run.smithi032.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-16T04:09:06.657 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:06.658 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:06.659 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:06.652+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:06.662 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=162, reqid=client.4631.0:37, at_version=34'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 49.709970224999999, 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005624703, 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.663 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.664 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7399999999999999e-07 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948775+0000", 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6127e-05 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948794+0000", 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9264000000000001e-05 2024-09-16T04:09:06.665 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948804+0000", 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7499999999999998e-06 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949606+0000", 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080285899999999995 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.666 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949616+0000", 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6900000000000004e-06 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954283+0000", 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046664230000000003 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954343+0000", 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0316000000000003e-05 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.667 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.625937397000001, 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049720880000000004, 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.668 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3900000000000001e-07 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.669 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032842+0000", 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0807e-05 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032862+0000", 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9660000000000002e-05 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032872+0000", 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0726e-05 2024-09-16T04:09:06.670 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032974+0000", 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101142 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032984+0000", 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0713000000000001e-05 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.671 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037679+0000", 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046946610000000001 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037723+0000", 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4140000000000001e-05 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:06.672 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 35.807225879000001, 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055937950000000004, 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.673 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0999999999999999e-07 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851488+0000", 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4587e-05 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.674 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851502+0000", 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4797000000000001e-05 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851514+0000", 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1073000000000001e-05 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.675 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853720+0000", 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00220616 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853745+0000", 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5653e-05 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857009+0000", 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003263775 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.676 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857056+0000", 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7240000000000002e-05 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 35.806567958999999, 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051176499999999996, 2024-09-16T04:09:06.677 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.678 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852121+0000", 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7599999999999996e-07 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852170+0000", 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9035000000000001e-05 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.679 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852191+0000", 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0472999999999999e-05 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852205+0000", 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4048e-05 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852390+0000", 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018541099999999999 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.680 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852418+0000", 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7985999999999999e-05 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857089+0000", 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046703320000000001 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857238+0000", 2024-09-16T04:09:06.681 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014958899999999999 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 35.806436484000002, 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050972430000000004, 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.682 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852253+0000", 2024-09-16T04:09:06.683 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1099999999999995e-07 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852285+0000", 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1846e-05 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852299+0000", 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4659e-05 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.684 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852310+0000", 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1287999999999999e-05 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853693+0000", 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001382826 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853719+0000", 2024-09-16T04:09:06.685 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6016e-05 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857307+0000", 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003587369 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857349+0000", 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2527999999999997e-05 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.686 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=226, reqid=client.4631.0:375, at_version=48'39, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 35.796409453000003, 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050701030000000003, 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:09:06.687 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862280+0000", 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2389999999999999e-06 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.688 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862380+0000", 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9331000000000002e-05 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862396+0000", 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6789000000000001e-05 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862409+0000", 2024-09-16T04:09:06.689 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2384e-05 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862627+0000", 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021813 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862652+0000", 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5519000000000001e-05 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867248+0000", 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045958509999999998 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867349+0000", 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010086000000000001 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:09:06.691 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 35.786046308000003, 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0069465819999999998, 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:09:06.692 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872645+0000", 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.384e-06 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872912+0000", 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00026752299999999998 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.693 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872958+0000", 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5624999999999998e-05 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872982+0000", 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4443e-05 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873128+0000", 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014554100000000001 2024-09-16T04:09:06.694 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873152+0000", 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4428000000000001e-05 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879494+0000", 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0063421629999999996 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879589+0000", 2024-09-16T04:09:06.695 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4475000000000006e-05 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=246, reqid=client.4631.0:409, at_version=53'51, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 30.76541022, 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0085214520000000005, 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.696 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.697 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893281+0000", 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4099999999999998e-06 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893613+0000", 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033196199999999999 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893658+0000", 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5498999999999999e-05 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893682+0000", 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4159e-05 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893893+0000", 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000210845 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893920+0000", 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6931999999999999e-05 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.699 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901667+0000", 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0077466979999999998 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901800+0000", 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013294700000000001 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.700 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=247, reqid=client.4631.0:410, at_version=53'52, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 30.761755004000001, 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004935488, 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:09:06.701 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896935+0000", 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8959999999999999e-06 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.702 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897016+0000", 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0438000000000005e-05 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897061+0000", 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4988999999999999e-05 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897084+0000", 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3139999999999999e-05 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.703 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897310+0000", 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000226424 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897334+0000", 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4083e-05 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901810+0000", 2024-09-16T04:09:06.704 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0044760260000000001 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901869+0000", 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8492000000000002e-05 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 29.591197278999999, 2024-09-16T04:09:06.705 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053273050000000001, 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.706 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067492+0000", 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0299999999999998e-07 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067551+0000", 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8916000000000003e-05 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.707 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067582+0000", 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1472e-05 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067606+0000", 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3485999999999998e-05 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000125365 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.708 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067741+0000", 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9890000000000004e-06 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072715+0000", 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049738159999999998 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072818+0000", 2024-09-16T04:09:06.709 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103458 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=307, reqid=client.4631.0:718, at_version=73'75, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.486573992, 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060468179999999998, 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.710 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172117+0000", 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1330000000000002e-06 2024-09-16T04:09:06.711 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172170+0000", 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3256e-05 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172211+0000", 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1554999999999998e-05 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.712 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172236+0000", 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4980000000000001e-05 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172713+0000", 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00047679299999999999 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172743+0000", 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0229000000000001e-05 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.713 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.178058+0000", 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053146169999999998 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.178161+0000", 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103255 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=308, reqid=client.4631.0:719, at_version=73'76, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:06.714 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.483841339, 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005380162, 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:09:06.715 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174850+0000", 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8100000000000002e-06 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174903+0000", 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2908999999999998e-05 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.716 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174935+0000", 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2660000000000002e-05 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174956+0000", 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0109e-05 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.175187+0000", 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00023095 2024-09-16T04:09:06.717 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.175210+0000", 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3736000000000001e-05 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180131+0000", 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049211790000000004 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.718 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180227+0000", 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5809000000000004e-05 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=309, reqid=client.4631.0:720, at_version=73'77, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.481894972999999, 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048893319999999997, 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.719 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176795+0000", 2024-09-16T04:09:06.720 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9230000000000001e-06 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176840+0000", 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4722999999999999e-05 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176874+0000", 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3835999999999999e-05 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.721 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176897+0000", 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2799999999999999e-05 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.177457+0000", 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00056058499999999995 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.177481+0000", 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4006e-05 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.722 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181605+0000", 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0041238280000000004 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181683+0000", 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7631000000000003e-05 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.723 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 74/31 ECSubWrite(tid=187, reqid=client.4631.0:758, at_version=74'47, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 9.6331656310000007, 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061683500000000004, 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.724 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025524+0000", 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.587e-06 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026540+0000", 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001015324 2024-09-16T04:09:06.725 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026570+0000", 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0642999999999998e-05 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026586+0000", 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6118999999999999e-05 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.726 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026721+0000", 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013497499999999999 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026737+0000", 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5763000000000001e-05 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.031644+0000", 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049069880000000001 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.727 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.031691+0000", 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6950999999999998e-05 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 79/31 ECSubWrite(tid=208, reqid=osd.13.0:208, at_version=79'71, trim_to=0'0, roll_forward_to=78'67))", 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.887781+0000", 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7709078800000002, 2024-09-16T04:09:06.728 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012267587, 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887781+0000", 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887781+0000", 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.729 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887782+0000", 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0300000000000001e-06 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887836+0000", 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4196000000000001e-05 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.730 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887863+0000", 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7670000000000001e-05 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887886+0000", 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2651999999999999e-05 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.888128+0000", 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024174999999999999 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.731 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.888152+0000", 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3842999999999999e-05 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.899954+0000", 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011802211 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.900048+0000", 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4234999999999995e-05 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 79/31 ECSubWrite(tid=343, reqid=osd.11.0:343, at_version=79'108, trim_to=0'0, roll_forward_to=78'106))", 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.892886+0000", 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7658019380000001, 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0073524920000000004, 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.733 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892886+0000", 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892886+0000", 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892887+0000", 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.734 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892941+0000", 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3742000000000001e-05 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892972+0000", 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1084000000000003e-05 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892994+0000", 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1713e-05 2024-09-16T04:09:06.735 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.893155+0000", 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016086400000000001 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.893179+0000", 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4723e-05 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.900057+0000", 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068773219999999999 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.900239+0000", 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000182351 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 79/31 ECSubWrite(tid=210, reqid=osd.13.0:208, at_version=0'0, trim_to=0'0, roll_forward_to=79'71))", 2024-09-16T04:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.901794+0000", 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7568945989999998, 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049036180000000002, 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901794+0000", 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.738 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901794+0000", 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901796+0000", 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.17e-06 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901882+0000", 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5572e-05 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.739 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901928+0000", 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6776000000000001e-05 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901956+0000", 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7492999999999999e-05 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904657+0000", 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002700727 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.740 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904681+0000", 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4003e-05 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.906608+0000", 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019274990000000001 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.906697+0000", 2024-09-16T04:09:06.741 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9377999999999997e-05 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 79/31 ECSubWrite(tid=211, reqid=osd.13.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=79'63))", 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.904235+0000", 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.7544535979999996, 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0086257030000000002, 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.742 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904235+0000", 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904235+0000", 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904236+0000", 2024-09-16T04:09:06.743 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.66e-06 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904260+0000", 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3445999999999999e-05 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904299+0000", 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9249999999999999e-05 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.744 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904328+0000", 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8883000000000001e-05 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904854+0000", 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00052583199999999995 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904877+0000", 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2866000000000001e-05 2024-09-16T04:09:06.745 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.912775+0000", 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0078980709999999996 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.912861+0000", 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5694999999999999e-05 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.746 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s6 79/31 ECSubWrite(tid=23, reqid=client.4631.0:863, at_version=79'13, trim_to=0'0, roll_forward_to=66'11))", 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:02.205296+0000", 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 4.4533924860000003, 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060453080000000001, 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205296+0000", 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.747 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205296+0000", 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205298+0000", 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.61e-06 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205477+0000", 2024-09-16T04:09:06.748 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017918799999999999 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205503+0000", 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6625999999999999e-05 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205520+0000", 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6963e-05 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.749 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205704+0000", 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000183974 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205731+0000", 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6838999999999998e-05 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.211258+0000", 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055268929999999997 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.750 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.211341+0000", 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3214999999999995e-05 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 79/31 ECSubWrite(tid=230, reqid=client.4631.0:930, at_version=0'0, trim_to=0'0, roll_forward_to=79'79))", 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:02.666156+0000", 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 3.992532062, 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051125490000000001, 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:06.751 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666156+0000", 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666156+0000", 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.752 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666157+0000", 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4e-07 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666169+0000", 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1701e-05 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666183+0000", 2024-09-16T04:09:06.753 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4178e-05 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666207+0000", 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4114999999999999e-05 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666276+0000", 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8547000000000006e-05 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:06.754 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666285+0000", 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5440000000000004e-06 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.671213+0000", 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049274890000000002 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.671269+0000", 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6134999999999997e-05 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.755 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.756 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.756 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:06.756 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:06.756 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:06.758 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-16T04:09:05.984709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":110068275,"num_objects":79,"num_object_clones":27,"num_object_copies":533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":3,"num_read":627,"num_read_kb":218536,"num_write":1029,"num_write_kb":153478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":9846784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1243,"ondisk_log_size":1243,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":648528,"kb_used_data":193148,"kb_used_omap":23,"kb_used_meta":455016,"kb_avail":1414929072,"statfs":{"total":1449551462400,"available":1448887369728,"internally_reserved":0,"allocated":197783552,"data_stored":245845121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23926,"internal_metadata":465937034},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20545536,"num_objects":15,"num_object_clones":13,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":91,"num_read_kb":62379,"num_write":142,"num_write_kb":27040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":9846784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001059"},"pg_stats":[{"pgid":"3.f","version":"79'68","reported_seq":338,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.911792+0000","last_change":"2024-09-16T04:09:01.905280+0000","last_active":"2024-09-16T04:09:03.911792+0000","last_peered":"2024-09-16T04:09:03.911792+0000","last_clean":"2024-09-16T04:09:03.911792+0000","last_became_active":"2024-09-16T04:08:14.947752+0000","last_became_peered":"2024-09-16T04:08:14.947752+0000","last_unstale":"2024-09-16T04:09:03.911792+0000","last_undegraded":"2024-09-16T04:09:03.911792+0000","last_fullsized":"2024-09-16T04:09:03.911792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:26.576651+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.019964124999999999,"stat_sum":{"num_bytes":2277376,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":15086,"num_write":20,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12,4,11,7,10,2],"acting":[13,12,4,11,7,10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"3.e","version":"82'67","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.945966+0000","last_change":"2024-09-16T04:09:04.945966+0000","last_active":"2024-09-16T04:09:04.945966+0000","last_peered":"2024-09-16T04:09:04.945966+0000","last_clean":"2024-09-16T04:09:04.945966+0000","last_became_active":"2024-09-16T04:09:04.885177+0000","last_became_peered":"2024-09-16T04:09:04.885177+0000","last_unstale":"2024-09-16T04:09:04.945966+0000","last_undegraded":"2024-09-16T04:09:04.945966+0000","last_fullsized":"2024-09-16T04:09:04.945966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:38.602068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023113019999999999,"stat_sum":{"num_bytes":8568832,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":20795,"num_write":32,"num_write_kb":10144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8568832,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,4,13,2,0,15],"acting":[3,11,4,13,2,0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.d","version":"73'22","reported_seq":272,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.911841+0000","last_change":"2024-09-16T04:09:01.885906+0000","last_active":"2024-09-16T04:09:03.911841+0000","last_peered":"2024-09-16T04:09:03.911841+0000","last_clean":"2024-09-16T04:09:03.911841+0000","last_became_active":"2024-09-16T04:08:15.857514+0000","last_became_peered":"2024-09-16T04:08:15.857514+0000","last_unstale":"2024-09-16T04:09:03.911841+0000","last_undegraded":"2024-09-16T04:09:03.911841+0000","last_fullsized":"2024-09-16T04:09:03.911841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:13.982018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066226100000000003,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":3856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,0,12,9,2,6],"acting":[13,1,0,12,9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"3.c","version":"79'83","reported_seq":333,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.917518+0000","last_change":"2024-09-16T04:09:01.916064+0000","last_active":"2024-09-16T04:09:03.917518+0000","last_peered":"2024-09-16T04:09:03.917518+0000","last_clean":"2024-09-16T04:09:03.917518+0000","last_became_active":"2024-09-16T04:08:14.948022+0000","last_became_peered":"2024-09-16T04:08:14.948022+0000","last_unstale":"2024-09-16T04:09:03.917518+0000","last_undegraded":"2024-09-16T04:09:03.917518+0000","last_fullsized":"2024-09-16T04:09:03.917518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.535480+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.022297495000000001,"stat_sum":{"num_bytes":11436032,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":11002,"num_write":54,"num_write_kb":13296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,13,12,4,2,6],"acting":[5,10,13,12,4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"3.b","version":"79'201","reported_seq":468,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-16T04:09:03.448646+0000","last_change":"2024-09-16T04:09:03.914380+0000","last_active":"2024-09-16T04:09:03.914380+0000","last_peered":"2024-09-16T04:09:03.448646+0000","last_clean":"2024-09-16T04:09:03.448646+0000","last_became_active":"2024-09-16T04:08:15.856491+0000","last_became_peered":"2024-09-16T04:08:15.856491+0000","last_unstale":"2024-09-16T04:09:03.448646+0000","last_undegraded":"2024-09-16T04:09:03.448646+0000","last_fullsized":"2024-09-16T04:09:03.448646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.025757453,"stat_sum":{"num_bytes":11698176,"num_objects":9,"num_object_clones":3,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":69,"num_read_kb":36096,"num_write":196,"num_write_kb":26544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6,11,15,12,1,14],"acting":[10,6,11,15,12,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,6,8,11,12,14,15],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"3.a","version":"79'79","reported_seq":341,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-16T04:09:02.896543+0000","last_change":"2024-09-16T04:09:03.912820+0000","last_active":"2024-09-16T04:09:03.912820+0000","last_peered":"2024-09-16T04:09:02.896543+0000","last_clean":"2024-09-16T04:09:02.896543+0000","last_became_active":"2024-09-16T04:08:15.858613+0000","last_became_peered":"2024-09-16T04:08:15.858613+0000","last_unstale":"2024-09-16T04:09:02.896543+0000","last_undegraded":"2024-09-16T04:09:02.896543+0000","last_fullsized":"2024-09-16T04:09:02.896543+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.017253015999999999,"stat_sum":{"num_bytes":7733248,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":12827,"num_write":32,"num_write_kb":8016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,4,9,0],"acting":[13,1,7,5,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1,4,5,7,8,9],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"3.9","version":"82'34","reported_seq":289,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:05.199731+0000","last_change":"2024-09-16T04:09:04.860088+0000","last_active":"2024-09-16T04:09:05.199731+0000","last_peered":"2024-09-16T04:09:05.199731+0000","last_clean":"2024-09-16T04:09:05.199731+0000","last_became_active":"2024-09-16T04:08:14.936519+0000","last_became_peered":"2024-09-16T04:08:14.936519+0000","last_unstale":"2024-09-16T04:09:05.199731+0000","last_undegraded":"2024-09-16T04:09:05.199731+0000","last_fullsized":"2024-09-16T04:09:05.199731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:25.970205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002462007,"stat_sum":{"num_bytes":5455872,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":18,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11,14,4,5,10,6],"acting":[12,11,14,4,5,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.8","version":"79'49","reported_seq":311,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.912419+0000","last_change":"2024-09-16T04:09:01.914814+0000","last_active":"2024-09-16T04:09:03.912419+0000","last_peered":"2024-09-16T04:09:03.912419+0000","last_clean":"2024-09-16T04:09:03.912419+0000","last_became_active":"2024-09-16T04:08:52.864471+0000","last_became_peered":"2024-09-16T04:08:52.864471+0000","last_unstale":"2024-09-16T04:09:03.912419+0000","last_undegraded":"2024-09-16T04:09:03.912419+0000","last_fullsized":"2024-09-16T04:09:03.912419+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:31.586536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022353326999999999,"stat_sum":{"num_bytes":3653632,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":6010,"num_write":20,"num_write_kb":6384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,0,15,14,1,4],"acting":[11,10,0,15,14,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"1.0","version":"27'157","reported_seq":317,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.906965+0000","last_change":"2024-09-16T04:08:01.759556+0000","last_active":"2024-09-16T04:09:03.906965+0000","last_peered":"2024-09-16T04:09:03.906965+0000","last_clean":"2024-09-16T04:09:03.906965+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:03.906965+0000","last_undegraded":"2024-09-16T04:09:03.906965+0000","last_fullsized":"2024-09-16T04:09:03.906965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.668359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.906974+0000","last_change":"2024-09-16T04:08:04.054624+0000","last_active":"2024-09-16T04:09:03.906974+0000","last_peered":"2024-09-16T04:09:03.906974+0000","last_clean":"2024-09-16T04:09:03.906974+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:03.906974+0000","last_undegraded":"2024-09-16T04:09:03.906974+0000","last_fullsized":"2024-09-16T04:09:03.906974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.326477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"79'114","reported_seq":376,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.907116+0000","last_change":"2024-09-16T04:09:01.936732+0000","last_active":"2024-09-16T04:09:03.907116+0000","last_peered":"2024-09-16T04:09:03.907116+0000","last_clean":"2024-09-16T04:09:03.907116+0000","last_became_active":"2024-09-16T04:08:15.856679+0000","last_became_peered":"2024-09-16T04:08:15.856679+0000","last_unstale":"2024-09-16T04:09:03.907116+0000","last_undegraded":"2024-09-16T04:09:03.907116+0000","last_fullsized":"2024-09-16T04:09:03.907116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:32.945207+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.046167030999999997,"stat_sum":{"num_bytes":12009472,"num_objects":7,"num_object_clones":2,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":46,"num_read_kb":29059,"num_write":55,"num_write_kb":15216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,12,13,1,5,3,7],"acting":[11,12,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.917774+0000","last_change":"2024-09-16T04:08:04.259701+0000","last_active":"2024-09-16T04:09:03.917774+0000","last_peered":"2024-09-16T04:09:03.917774+0000","last_clean":"2024-09-16T04:09:03.917774+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:03.917774+0000","last_undegraded":"2024-09-16T04:09:03.917774+0000","last_fullsized":"2024-09-16T04:09:03.917774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:17.342272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"82'26","reported_seq":288,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:05.019770+0000","last_change":"2024-09-16T04:09:04.860198+0000","last_active":"2024-09-16T04:09:05.019770+0000","last_peered":"2024-09-16T04:09:05.019770+0000","last_clean":"2024-09-16T04:09:05.019770+0000","last_became_active":"2024-09-16T04:08:15.495747+0000","last_became_peered":"2024-09-16T04:08:15.495747+0000","last_unstale":"2024-09-16T04:09:05.019770+0000","last_undegraded":"2024-09-16T04:09:05.019770+0000","last_fullsized":"2024-09-16T04:09:05.019770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:21.251688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002031728,"stat_sum":{"num_bytes":6586368,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":4711,"num_write":21,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13,3,11,12,0,7],"acting":[6,13,3,11,12,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.861926+0000","last_change":"2024-09-16T04:08:04.259137+0000","last_active":"2024-09-16T04:09:04.861926+0000","last_peered":"2024-09-16T04:09:04.861926+0000","last_clean":"2024-09-16T04:09:04.861926+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:04.861926+0000","last_undegraded":"2024-09-16T04:09:04.861926+0000","last_fullsized":"2024-09-16T04:09:04.861926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:14.458825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"79'60","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.976848+0000","last_change":"2024-09-16T04:09:04.860443+0000","last_active":"2024-09-16T04:09:04.976848+0000","last_peered":"2024-09-16T04:09:04.976848+0000","last_clean":"2024-09-16T04:09:04.976848+0000","last_became_active":"2024-09-16T04:08:15.466434+0000","last_became_peered":"2024-09-16T04:08:15.466434+0000","last_unstale":"2024-09-16T04:09:04.976848+0000","last_undegraded":"2024-09-16T04:09:04.976848+0000","last_fullsized":"2024-09-16T04:09:04.976848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:30.069186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599376,"stat_sum":{"num_bytes":1064960,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":10526,"num_write":65,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,5,9,3,13,11,6],"acting":[12,5,9,3,13,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.2","version":"27'2","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.913746+0000","last_change":"2024-09-16T04:08:03.691916+0000","last_active":"2024-09-16T04:09:03.913746+0000","last_peered":"2024-09-16T04:09:03.913746+0000","last_clean":"2024-09-16T04:09:03.913746+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:03.913746+0000","last_undegraded":"2024-09-16T04:09:03.913746+0000","last_fullsized":"2024-09-16T04:09:03.913746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:28.281939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"82'64","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:05.138869+0000","last_change":"2024-09-16T04:09:04.864909+0000","last_active":"2024-09-16T04:09:05.138869+0000","last_peered":"2024-09-16T04:09:05.138869+0000","last_clean":"2024-09-16T04:09:05.138869+0000","last_became_active":"2024-09-16T04:08:14.946050+0000","last_became_peered":"2024-09-16T04:08:14.946050+0000","last_unstale":"2024-09-16T04:09:05.138869+0000","last_undegraded":"2024-09-16T04:09:05.138869+0000","last_fullsized":"2024-09-16T04:09:05.138869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:35.794888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882459,"stat_sum":{"num_bytes":8323072,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":38,"num_read_kb":16009,"num_write":95,"num_write_kb":10192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,2,13,4,6,5],"acting":[15,9,2,13,4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"3.5","version":"79'45","reported_seq":323,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-16T04:09:03.189520+0000","last_change":"2024-09-16T04:09:03.919962+0000","last_active":"2024-09-16T04:09:03.919962+0000","last_peered":"2024-09-16T04:09:03.189520+0000","last_clean":"2024-09-16T04:09:03.189520+0000","last_became_active":"2024-09-16T04:08:14.934767+0000","last_became_peered":"2024-09-16T04:08:14.934767+0000","last_unstale":"2024-09-16T04:09:03.189520+0000","last_undegraded":"2024-09-16T04:09:03.189520+0000","last_fullsized":"2024-09-16T04:09:03.189520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.038516769999999999,"stat_sum":{"num_bytes":5423104,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":15881,"num_write":41,"num_write_kb":6352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,14,9,10,13,15],"acting":[5,6,14,9,10,13,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,8,9,10,13,14,15],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.862133+0000","last_change":"2024-09-16T04:08:04.263713+0000","last_active":"2024-09-16T04:09:04.862133+0000","last_peered":"2024-09-16T04:09:04.862133+0000","last_clean":"2024-09-16T04:09:04.862133+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:04.862133+0000","last_undegraded":"2024-09-16T04:09:04.862133+0000","last_fullsized":"2024-09-16T04:09:04.862133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.739694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"79'152","reported_seq":412,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.912785+0000","last_change":"2024-09-16T04:09:01.939760+0000","last_active":"2024-09-16T04:09:03.912785+0000","last_peered":"2024-09-16T04:09:03.912785+0000","last_clean":"2024-09-16T04:09:03.912785+0000","last_became_active":"2024-09-16T04:08:15.495248+0000","last_became_peered":"2024-09-16T04:08:15.495248+0000","last_unstale":"2024-09-16T04:09:03.912785+0000","last_undegraded":"2024-09-16T04:09:03.912785+0000","last_fullsized":"2024-09-16T04:09:03.912785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:22.564600+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.047029933000000003,"stat_sum":{"num_bytes":21397504,"num_objects":9,"num_object_clones":3,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":42,"num_read_kb":23119,"num_write":153,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,14,3,15,6,0],"acting":[10,12,14,3,15,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"13","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-16T04:08:59.853884+0000","last_change":"2024-09-16T04:08:03.690441+0000","last_active":"2024-09-16T04:08:59.853884+0000","last_peered":"2024-09-16T04:08:59.853884+0000","last_clean":"2024-09-16T04:08:59.853884+0000","last_became_active":"2024-09-16T04:08:01.758753+0000","last_became_peered":"2024-09-16T04:08:01.758753+0000","last_unstale":"2024-09-16T04:08:59.853884+0000","last_undegraded":"2024-09-16T04:08:59.853884+0000","last_fullsized":"2024-09-16T04:08:59.853884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:27.377710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050223399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.7","version":"79'6","reported_seq":285,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.977938+0000","last_change":"2024-09-16T04:09:04.905453+0000","last_active":"2024-09-16T04:09:04.977938+0000","last_peered":"2024-09-16T04:09:04.977938+0000","last_clean":"2024-09-16T04:09:04.977938+0000","last_became_active":"2024-09-16T04:09:04.879291+0000","last_became_peered":"2024-09-16T04:09:04.879291+0000","last_unstale":"2024-09-16T04:09:04.977938+0000","last_undegraded":"2024-09-16T04:09:04.977938+0000","last_fullsized":"2024-09-16T04:09:04.977938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:15.045577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00184034,"stat_sum":{"num_bytes":638976,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":7493,"num_write":4,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1277952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,7,4,11,6,13],"acting":[14,5,7,4,11,6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.863822+0000","last_change":"2024-09-16T04:08:03.691261+0000","last_active":"2024-09-16T04:09:04.863822+0000","last_peered":"2024-09-16T04:09:04.863822+0000","last_clean":"2024-09-16T04:09:04.863822+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:04.863822+0000","last_undegraded":"2024-09-16T04:09:04.863822+0000","last_fullsized":"2024-09-16T04:09:04.863822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:09.778247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.6","version":"42'13","reported_seq":276,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T04:09:04.860877+0000","last_change":"2024-09-16T04:09:04.861947+0000","last_active":"2024-09-16T04:09:04.860877+0000","last_peered":"2024-09-16T04:09:04.860877+0000","last_clean":"2024-09-16T04:09:04.860877+0000","last_became_active":"2024-09-16T04:08:15.494877+0000","last_became_peered":"2024-09-16T04:08:15.494877+0000","last_unstale":"2024-09-16T04:09:04.860877+0000","last_undegraded":"2024-09-16T04:09:04.860877+0000","last_fullsized":"2024-09-16T04:09:04.860877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:13.887992+0000","last_clean_scrub_stamp":"2024-09-16T04:08:13.887992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:38.244723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055769410000000002,"stat_sum":{"num_bytes":1114112,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":9797,"num_write":6,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7,15,5,11,9,0],"acting":[14,7,15,5,11,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"15","length":"1"},{"start":"17","length":"1"},{"start":"1a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T04:09:03.912168+0000","last_change":"2024-09-16T04:08:03.692126+0000","last_active":"2024-09-16T04:09:03.912168+0000","last_peered":"2024-09-16T04:09:03.912168+0000","last_clean":"2024-09-16T04:09:03.912168+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:03.912168+0000","last_undegraded":"2024-09-16T04:09:03.912168+0000","last_fullsized":"2024-09-16T04:09:03.912168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:08:00.660153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:09:16.620189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":109477888,"num_objects":75,"num_object_clones":27,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":3,"num_read":491,"num_read_kb":218418,"num_write":824,"num_write_kb":150016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":9846784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":187703296,"data_stored":259317760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1083,"ondisk_log_size":1083,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247823,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46952,"kb_used_data":15764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324888,"statfs":{"total":96636764160,"available":96588685312,"internally_reserved":0,"allocated":16142336,"data_stored":18494957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247824,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43368,"kb_used_data":12180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328472,"statfs":{"total":96636764160,"available":96592355328,"internally_reserved":0,"allocated":12472320,"data_stored":14628333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247824,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51996,"kb_used_data":16648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319844,"statfs":{"total":96636764160,"available":96583520256,"internally_reserved":0,"allocated":17047552,"data_stored":25060845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313232,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36048,"kb_used_data":9020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335792,"statfs":{"total":96636764160,"available":96599851008,"internally_reserved":0,"allocated":9236480,"data_stored":10693274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,5,6,7,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280528,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":9864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":10100736,"data_stored":12428045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280528,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48300,"kb_used_data":12944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323540,"statfs":{"total":96636764160,"available":96587304960,"internally_reserved":0,"allocated":13254656,"data_stored":16510058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280529,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35384,"kb_used_data":8352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336456,"statfs":{"total":96636764160,"available":96600530944,"internally_reserved":0,"allocated":8552448,"data_stored":10349674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280529,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34256,"kb_used_data":7224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337584,"statfs":{"total":96636764160,"available":96601686016,"internally_reserved":0,"allocated":7397376,"data_stored":8248426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280529,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42120,"kb_used_data":15088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329720,"statfs":{"total":96636764160,"available":96593633280,"internally_reserved":0,"allocated":15450112,"data_stored":18893949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280529,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44720,"kb_used_data":13528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327120,"statfs":{"total":96636764160,"available":96590970880,"internally_reserved":0,"allocated":13852672,"data_stored":16408202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280528,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48228,"kb_used_data":17036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323612,"statfs":{"total":96636764160,"available":96587378688,"internally_reserved":0,"allocated":17444864,"data_stored":21359741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247823,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45016,"kb_used_data":13824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326824,"statfs":{"total":96636764160,"available":96590667776,"internally_reserved":0,"allocated":14155776,"data_stored":19216397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247825,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44444,"kb_used_data":13256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327396,"statfs":{"total":96636764160,"available":96591253504,"internally_reserved":0,"allocated":13574144,"data_stored":16291309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247823,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41096,"kb_used_data":9900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330744,"statfs":{"total":96636764160,"available":96594681856,"internally_reserved":0,"allocated":10137600,"data_stored":11943018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247824,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49708,"kb_used_data":18520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322132,"statfs":{"total":96636764160,"available":96585863168,"internally_reserved":0,"allocated":18964480,"data_stored":25318893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":0,"seq":98784247823,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12451840,"data_stored":18010112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8962048,"data_stored":11771904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8114176,"data_stored":10047488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12529664,"data_stored":20123648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12419072,"data_stored":15982592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12099584,"data_stored":15843328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18735104,"data_stored":28205056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7397376,"data_stored":9682944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":2924544,"data_stored":3911680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":7581696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":14290944,"data_stored":18227200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12165120,"data_stored":15212544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":15876096,"data_stored":25047040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":16285696,"data_stored":20692992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":12177408,"data_stored":17473536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":15032320,"data_stored":21504000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:06.760 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-16T04:09:06.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-16T04:09:06.760 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:09:06.756+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:09:06.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:09:06.858 INFO:tasks.ceph.osd.12.smithi032.stderr:2024-09-16T04:09:06.852+0000 7f25869e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 26368) UID: 0 2024-09-16T04:09:06.889 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:06.889 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:06.889 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:09:06.889 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:06.903 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:09:06.959 INFO:tasks.ceph.osd.10.smithi196.stderr:2024-09-16T04:09:06.957+0000 7f48f3add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 26384) UID: 0 2024-09-16T04:09:07.023 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:07.023 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:07.023 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:07.024 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:07.024 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:07.038 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:09:07.059 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-09-16T04:09:07.056+0000 7f5f29ee5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26364) UID: 0 2024-09-16T04:09:07.160 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:07.155+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4347.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 65.478798757999996, 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.078945607000000001, 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.165 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4347", 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.166 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680776+0000", 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680789+0000", 2024-09-16T04:09:07.167 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3190000000000001e-05 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680818+0000", 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9221999999999999e-05 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680843+0000", 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5341e-05 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.168 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681117+0000", 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027343099999999998 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681133+0000", 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6121999999999999e-05 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756693+0000", 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.075560459999999996 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.169 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756940+0000", 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000246987 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 5", 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.757281+0000", 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034121100000000001 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758584+0000", 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013029490000000001 2024-09-16T04:09:07.170 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759577+0000", 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00099302500000000003 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759652+0000", 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4519999999999998e-05 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.171 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759718+0000", 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5798999999999998e-05 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:09:07.172 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 65.473087692000007, 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.074795126000000003, 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.173 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686485+0000", 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.658e-06 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.174 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686493+0000", 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4970000000000001e-06 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686508+0000", 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4491999999999999e-05 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686518+0000", 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0458e-05 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.175 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686592+0000", 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3489000000000001e-05 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686600+0000", 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9230000000000002e-06 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758022+0000", 2024-09-16T04:09:07.176 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.071421947 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758412+0000", 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038979599999999998 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758762+0000", 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00035026099999999999 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:09:07.177 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.760052+0000", 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012898219999999999 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761194+0000", 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001142505 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761242+0000", 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7673000000000002e-05 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.178 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761278+0000", 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6604999999999999e-05 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:10 3.2s0 3:47904bf5:::smithi20431790-4:head [append 0~65536,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.227473738999997, 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018864736, 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.179 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 10 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.180 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932099+0000", 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2199999999999999e-06 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932178+0000", 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.181 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932195+0000", 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7448999999999998e-05 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932210+0000", 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5338000000000001e-05 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932298+0000", 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8108000000000004e-05 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.182 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932407+0000", 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000108142 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933041+0000", 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00063471100000000004 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935398+0000", 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0023565420000000001 2024-09-16T04:09:07.183 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950884+0000", 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015486107000000001 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950962+0000", 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7970000000000001e-05 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:11 3.2s0 3:47904bf5:::smithi20431790-4:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.227316254000002, 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018963179, 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 11 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.185 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:07.186 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9400000000000005e-07 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932260+0000", 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9710000000000003e-06 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932272+0000", 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1394e-05 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932280+0000", 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6540000000000005e-06 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933560+0000", 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012794550000000001 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933703+0000", 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014327099999999999 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934311+0000", 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00060811199999999995 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001087619 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951109+0000", 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015710114000000001 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.189 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951218+0000", 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010889499999999999 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:12 3.2s0 3:47904bf5:::smithi20431790-4:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.227244962999997, 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026513838000000001, 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.190 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 12 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.191 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932327+0000", 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4600000000000003e-07 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932331+0000", 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.192 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932343+0000", 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2442999999999999e-05 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932356+0000", 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2947e-05 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935242+0000", 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028857570000000001 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.193 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935348+0000", 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010570500000000001 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951277+0000", 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015929606999999998 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951330+0000", 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2148000000000003e-05 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.194 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.958840+0000", 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0075102520000000002 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:27 3.8s0 3:11971f68:::smithi20431790-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.220716271999997, 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023242002000000001, 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.195 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 27 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.196 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3399999999999999e-07 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938866+0000", 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0725e-05 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.197 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938877+0000", 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1277999999999999e-05 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938884+0000", 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1969999999999999e-06 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940649+0000", 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001764126 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.198 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940737+0000", 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8554000000000006e-05 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957784+0000", 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017047128000000002 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9390999999999999e-05 2024-09-16T04:09:07.199 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.962097+0000", 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042329689999999996 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:39 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.212112437999998, 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018733970999999999, 2024-09-16T04:09:07.200 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 39 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.201 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947459+0000", 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4000000000000002e-07 2024-09-16T04:09:07.202 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947462+0000", 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8959999999999999e-06 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947471+0000", 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8680000000000005e-06 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947477+0000", 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3300000000000004e-06 2024-09-16T04:09:07.203 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950100+0000", 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026232159999999998 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950184+0000", 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3891e-05 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963530+0000", 2024-09-16T04:09:07.204 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013345658 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963589+0000", 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8748000000000001e-05 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966192+0000", 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026038239999999998 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.205 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:45 3.2s0 3:43e872cf:::smithi20431790-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.20720652, 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020624611000000001, 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 45 2024-09-16T04:09:07.206 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.207 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952365+0000", 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.79e-07 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952366+0000", 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1400000000000001e-06 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952369+0000", 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5889999999999999e-06 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.208 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952372+0000", 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7460000000000001e-06 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959119+0000", 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067464609999999996 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959501+0000", 2024-09-16T04:09:07.209 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038236699999999999 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970077+0000", 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010575599 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970122+0000", 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5423999999999997e-05 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.972989+0000", 2024-09-16T04:09:07.210 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028670060000000001 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:296 3.2s0 3:47aa9112:::smithi20431790-43:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.142913114000002, 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.022372174000000002, 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.211 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 296 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.212 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016661+0000", 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3730000000000001e-06 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016676+0000", 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4735999999999999e-05 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.213 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016718+0000", 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1995e-05 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016743+0000", 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4697000000000001e-05 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016889+0000", 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014660300000000001 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.214 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016902+0000", 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3125000000000001e-05 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.028135+0000", 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011232884 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.028307+0000", 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017155600000000001 2024-09-16T04:09:07.215 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029615+0000", 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001308299 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038024+0000", 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0084091359999999993 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.216 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038830+0000", 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080528499999999999 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039030+0000", 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000200485 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:297 3.2s0 3:47aa9112:::smithi20431790-43:head [rollback 6] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.217 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.142768517, 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023235478, 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 297 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.218 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016803+0000", 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8999999999999995e-07 2024-09-16T04:09:07.219 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016809+0000", 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.383e-06 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016840+0000", 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1494e-05 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016852+0000", 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1909999999999999e-05 2024-09-16T04:09:07.220 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016990+0000", 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013789100000000001 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016997+0000", 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4989999999999997e-06 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.032055+0000", 2024-09-16T04:09:07.221 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015057667 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.032258+0000", 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000203131 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034469+0000", 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00221097 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038026+0000", 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003557017 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039824+0000", 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001797482 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040038+0000", 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021414399999999999 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.223 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:298 3.2s0 3:47aa9112:::smithi20431790-43:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.142676530999999, 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026598553, 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.224 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 298 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.225 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016895+0000", 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7199999999999997e-07 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016901+0000", 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2970000000000003e-06 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016914+0000", 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.364e-05 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016927+0000", 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3084e-05 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017040+0000", 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000112871 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017045+0000", 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3240000000000002e-06 2024-09-16T04:09:07.227 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.035806+0000", 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018760585 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.036098+0000", 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029218199999999999 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.037257+0000", 2024-09-16T04:09:07.228 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001159207 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039176+0000", 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019182789999999999 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043033+0000", 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003857002 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.229 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043493+0000", 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046021000000000001 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:299 3.2s0 3:471dade1:::smithi20431790-28:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.142627505999997, 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.033537681, 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.230 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 299 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.231 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016944+0000", 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3799999999999997e-07 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016949+0000", 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3199999999999999e-06 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.232 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016963+0000", 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3137e-05 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016972+0000", 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3600000000000002e-06 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017101+0000", 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000129536 2024-09-16T04:09:07.233 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017109+0000", 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1080000000000004e-06 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040363+0000", 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023254582999999999 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040426+0000", 2024-09-16T04:09:07.234 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2757999999999998e-05 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040920+0000", 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00049433799999999998 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.046996+0000", 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060755890000000002 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.235 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050239+0000", 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032429770000000002 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050481+0000", 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024233699999999999 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:300 3.2s0 3:471dade1:::smithi20431790-28:head [rollback 7] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:09:07.236 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.142587687000002, 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.034915521999999997, 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 300 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.237 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016984+0000", 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.75e-07 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.238 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016987+0000", 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5599999999999998e-06 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016999+0000", 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.117e-05 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017008+0000", 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4399999999999994e-06 2024-09-16T04:09:07.239 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017152+0000", 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014403800000000001 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017158+0000", 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4580000000000001e-06 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043910+0000", 2024-09-16T04:09:07.240 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026752120000000001 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.044066+0000", 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000156408 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.045632+0000", 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0015661690000000001 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.241 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047448+0000", 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018157169999999999 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.051829+0000", 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0043809010000000004 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.051899+0000", 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9865999999999998e-05 2024-09-16T04:09:07.242 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:301 3.2s0 3:471dade1:::smithi20431790-28:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.142551843, 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.037019252000000002, 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.243 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 301 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.244 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017020+0000", 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2799999999999996e-07 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017024+0000", 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8039999999999999e-06 2024-09-16T04:09:07.245 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017034+0000", 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0631999999999999e-05 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017043+0000", 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2080000000000006e-06 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017183+0000", 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000140082 2024-09-16T04:09:07.246 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017191+0000", 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2400000000000001e-06 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047641+0000", 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.030450652000000002 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047877+0000", 2024-09-16T04:09:07.247 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000235307 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.049191+0000", 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013143950000000001 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050617+0000", 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001426306 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.248 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.053870+0000", 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032524400000000001 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.054038+0000", 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016855799999999999 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:375 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [append 0~638976] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:09:07.249 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 36.304348290999997, 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.025565072000000001, 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 375 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:09:07.250 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855226+0000", 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.23e-06 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.251 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858178+0000", 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029523180000000002 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858274+0000", 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6217000000000004e-05 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858302+0000", 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8005999999999999e-05 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.252 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858504+0000", 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020172500000000001 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858809+0000", 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00030490500000000001 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861536+0000", 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027273269999999999 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.253 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867748+0000", 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0062119569999999997 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880622+0000", 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012873648999999999 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880788+0000", 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016573799999999999 2024-09-16T04:09:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:379 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 36.290203769999998, 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020566435000000001, 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.255 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 379 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.256 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869368+0000", 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.034e-06 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869372+0000", 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869383+0000", 2024-09-16T04:09:07.257 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1143e-05 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869392+0000", 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5569999999999996e-06 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883593+0000", 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014200855 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883796+0000", 2024-09-16T04:09:07.258 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020284599999999999 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.887050+0000", 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032546789999999999 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.887240+0000", 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019004499999999999 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.259 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.889934+0000", 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026931429999999998 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:542 3.2s0 3:47904bf5:::smithi20431790-4:head [copy-from ver 78] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.907029+0000", 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 20.252542310999999, 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.040957433000000001, 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.260 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 542 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907029+0000", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907029+0000", 2024-09-16T04:09:07.261 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907031+0000", 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8399999999999999e-06 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907045+0000", 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3327e-05 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907075+0000", 2024-09-16T04:09:07.262 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0412e-05 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907094+0000", 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9057000000000001e-05 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907280+0000", 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018560899999999999 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:07.263 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907345+0000", 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5189000000000002e-05 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.910874+0000", 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003528743 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.911105+0000", 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00023097300000000001 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.945039+0000", 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.033933945 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.947443+0000", 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0024045630000000002 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.947740+0000", 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029698700000000002 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.265 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.947986+0000", 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024578799999999999 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:543 3.2s0 3:47904bf5:::smithi20431790-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.907160+0000", 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 20.252410525999998, 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.039728354, 2024-09-16T04:09:07.266 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 543 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907160+0000", 2024-09-16T04:09:07.267 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907160+0000", 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907162+0000", 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6190000000000001e-06 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.268 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907170+0000", 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9699999999999999e-06 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907195+0000", 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5109999999999998e-05 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907214+0000", 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8695999999999999e-05 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.269 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907503+0000", 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00028883799999999997 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907520+0000", 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7373000000000001e-05 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.911325+0000", 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038049780000000001 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.270 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.911392+0000", 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7144000000000006e-05 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.946709+0000", 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.035316985000000002 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.946793+0000", 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3605999999999999e-05 2024-09-16T04:09:07.271 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.946889+0000", 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6034999999999998e-05 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:566 3.8s0 3:19f223a2:::smithi20431790-32:head [copy-from ver 9] snapc 11=[11] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:47.913533+0000", 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 19.246037782999998, 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023827824000000001, 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.272 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 566 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913533+0000", 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.273 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913533+0000", 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913536+0000", 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8430000000000001e-06 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913570+0000", 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4218999999999999e-05 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.274 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913604+0000", 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4053000000000001e-05 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913622+0000", 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7496e-05 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913786+0000", 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016425700000000001 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.275 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913808+0000", 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2419999999999999e-05 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917311+0000", 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003502663 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917401+0000", 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0127e-05 2024-09-16T04:09:07.276 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.932083+0000", 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014681654000000001 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934751+0000", 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026678079999999998 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.937235+0000", 2024-09-16T04:09:07.277 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0024840539999999999 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.937361+0000", 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012622999999999999 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:567 3.8s0 3:19f223a2:::smithi20431790-32:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:47.913655+0000", 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 19.245916392000002, 2024-09-16T04:09:07.278 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.021092189000000001, 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 567 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913655+0000", 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.279 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913655+0000", 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913656+0000", 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5269999999999999e-06 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913663+0000", 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3889999999999999e-06 2024-09-16T04:09:07.280 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913697+0000", 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3760000000000002e-05 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913708+0000", 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0662999999999999e-05 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913959+0000", 2024-09-16T04:09:07.281 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00025156199999999999 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913972+0000", 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2557e-05 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917557+0000", 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035854849999999998 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917596+0000", 2024-09-16T04:09:07.282 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8275000000000002e-05 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934111+0000", 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.016515133000000001 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934382+0000", 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027138500000000002 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.283 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934747+0000", 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00036445299999999999 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.284 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:07.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:09:07.286 INFO:tasks.ceph.osd.14.smithi196.stderr:2024-09-16T04:09:07.281+0000 7efd778b1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 26386) UID: 0 2024-09-16T04:09:07.386 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:07.383+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:07.457 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:07.457 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:07.457 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:09:07.457 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:07.472 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:09:07.487 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:09:07.483+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:09:07.588 INFO:tasks.ceph.osd.11.smithi204.stderr:2024-09-16T04:09:07.583+0000 7f2263b84640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 26634) UID: 0 2024-09-16T04:09:07.637 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:07.637 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:07.637 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:07.637 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:07.637 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:07.651 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:09:07.690 INFO:tasks.ceph.osd.13.smithi050.stderr:2024-09-16T04:09:07.687+0000 7f008ffe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 26266) UID: 0 2024-09-16T04:09:07.790 INFO:tasks.ceph.osd.15.smithi204.stderr:2024-09-16T04:09:07.787+0000 7f6f7f3ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 26637) UID: 0 2024-09-16T04:09:07.822 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:16 3.3s0 3:c529a602:::smithi20431790-6:head [append 0~98304,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.882611771000001, 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019299383, 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.823 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 16 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.824 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935202+0000", 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1500000000000002e-06 2024-09-16T04:09:07.825 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935324+0000", 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000121543 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935343+0000", 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9576e-05 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.826 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935354+0000", 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0305e-05 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935432+0000", 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.827 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935534+0000", 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102352 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936270+0000", 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00073583600000000002 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940246+0000", 2024-09-16T04:09:07.828 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039756180000000002 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954404+0000", 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014158278 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954499+0000", 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5575999999999994e-05 2024-09-16T04:09:07.829 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:17 3.3s0 3:c529a602:::smithi20431790-6:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.882428593999997, 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019292492000000001, 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.830 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 17 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.831 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935384+0000", 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4099999999999997e-07 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.832 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935389+0000", 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2329999999999997e-06 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8409999999999995e-06 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935409+0000", 2024-09-16T04:09:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8600000000000005e-06 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936658+0000", 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012486140000000001 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936736+0000", 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8772999999999999e-05 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.834 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937204+0000", 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046781200000000001 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941222+0000", 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0040175799999999998 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.835 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954596+0000", 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013374425000000001 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954676+0000", 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9512999999999996e-05 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.836 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:18 3.3s0 3:c529a602:::smithi20431790-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.882391247000001, 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.028831239000000002, 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.837 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 18 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:07.838 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4700000000000001e-07 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935425+0000", 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3689999999999998e-06 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.839 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935433+0000", 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4379999999999995e-06 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935442+0000", 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2660000000000007e-06 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.840 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937434+0000", 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001991488 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937526+0000", 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2130000000000001e-05 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.841 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955047+0000", 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01752107 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955134+0000", 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7058000000000006e-05 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.964252+0000", 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091177729999999992 2024-09-16T04:09:07.842 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:54 3.3s0 3:cd6753c4:::smithi20431790-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.852140200000001, 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012514735000000001, 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.843 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 54 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.844 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8500000000000002e-07 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.845 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965675+0000", 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.717e-06 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965681+0000", 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3740000000000003e-06 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965688+0000", 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1319999999999996e-06 2024-09-16T04:09:07.846 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967631+0000", 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001942608 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967683+0000", 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2407000000000002e-05 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.847 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0065591089999999996 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974296+0000", 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.304e-05 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.848 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978186+0000", 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003890863 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:61 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [append 0~344064,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.843942298999998, 2024-09-16T04:09:07.849 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014009466, 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 61 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.850 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973871+0000", 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.42e-06 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974203+0000", 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000331649 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974215+0000", 2024-09-16T04:09:07.852 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2428e-05 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974223+0000", 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4090000000000003e-06 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974499+0000", 2024-09-16T04:09:07.853 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027562300000000001 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974613+0000", 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011410500000000001 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.975669+0000", 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010556929999999999 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.854 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978426+0000", 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027567379999999999 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987790+0000", 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093645580000000003 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.855 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987879+0000", 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8843000000000003e-05 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:62 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.843571130000001, 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01382477, 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.856 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 62 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:09:07.857 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.043e-06 2024-09-16T04:09:07.858 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974246+0000", 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7500000000000003e-06 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974255+0000", 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6889999999999993e-06 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.859 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974262+0000", 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8020000000000003e-06 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976035+0000", 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001773513 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.860 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976098+0000", 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2561e-05 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976446+0000", 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034762200000000001 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.861 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978428+0000", 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019825789999999999 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987964+0000", 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0095358739999999997 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988065+0000", 2024-09-16T04:09:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101337 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:63 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.843542747000001, 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017999409000000001, 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.863 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 63 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.864 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0200000000000003e-07 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.865 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974272+0000", 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6450000000000001e-06 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974280+0000", 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3900000000000004e-06 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974287+0000", 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9410000000000007e-06 2024-09-16T04:09:07.866 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977414+0000", 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031265419999999999 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977505+0000", 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0589999999999998e-05 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.867 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988472+0000", 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010967144999999999 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988572+0000", 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9774999999999999e-05 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.868 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.992268+0000", 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003696979 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:123 3.3s0 3:cbefa139:::smithi20431790-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 50.772189050999998, 2024-09-16T04:09:07.869 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091212429999999994, 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 123 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.870 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0999999999999998e-07 2024-09-16T04:09:07.871 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045626+0000", 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7360000000000001e-06 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045634+0000", 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.469e-06 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.872 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045640+0000", 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7340000000000002e-06 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048271+0000", 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026307589999999999 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.873 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048353+0000", 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2093000000000002e-05 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053037+0000", 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046837609999999998 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053109+0000", 2024-09-16T04:09:07.874 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1594999999999995e-05 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.054744+0000", 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001635486 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:290 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:09:07.875 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.772828881000002, 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092576150000000003, 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 290 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.876 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.877 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044984+0000", 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0699999999999996e-07 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044990+0000", 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6370000000000002e-06 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045001+0000", 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0253e-05 2024-09-16T04:09:07.878 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045008+0000", 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5179999999999998e-06 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045111+0000", 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102534 2024-09-16T04:09:07.879 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045116+0000", 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047750+0000", 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026333289999999998 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.880 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047840+0000", 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0716000000000004e-05 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.054241+0000", 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064002479999999999 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.881 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:291 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 41.772792463999998, 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010030295999999999, 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.882 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 291 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:09:07.883 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045020+0000", 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8100000000000003e-07 2024-09-16T04:09:07.884 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045024+0000", 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8580000000000002e-06 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045032+0000", 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3310000000000004e-06 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.885 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045039+0000", 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6320000000000002e-06 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045164+0000", 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012537599999999999 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045172+0000", 2024-09-16T04:09:07.886 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5750000000000003e-06 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048140+0000", 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029680029999999999 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048205+0000", 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5269000000000001e-05 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.887 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.055050+0000", 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068446710000000001 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:307 3.3s0 3:c529a602:::smithi20431790-6:head [rollback 7] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 40.774634863999999, 2024-09-16T04:09:07.888 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010861308, 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 307 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:09:07.889 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043180+0000", 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.890 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043196+0000", 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6101999999999999e-05 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043245+0000", 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8809e-05 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.891 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043270+0000", 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4379000000000002e-05 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043464+0000", 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019390799999999999 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.892 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043483+0000", 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9568999999999998e-05 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047345+0000", 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038619930000000002 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.893 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047636+0000", 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029135800000000002 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.054038+0000", 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064018399999999998 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.894 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 36.960943217000001, 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010163948000000001, 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.895 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.896 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856870+0000", 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.297e-06 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856931+0000", 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0594000000000003e-05 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.897 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856960+0000", 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9413000000000001e-05 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856983+0000", 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2623e-05 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857134+0000", 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015194899999999999 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857159+0000", 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4603000000000001e-05 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.866937+0000", 2024-09-16T04:09:07.899 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0097774980000000008 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867033+0000", 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5971000000000007e-05 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.900 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.bs3 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 36.960590822999997, 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0099345739999999998, 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:09:07.901 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857222+0000", 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.176e-06 2024-09-16T04:09:07.902 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857325+0000", 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010283799999999999 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857351+0000", 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6325999999999998e-05 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.903 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857371+0000", 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9854999999999999e-05 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857658+0000", 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000286347 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857684+0000", 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6879000000000001e-05 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867077+0000", 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093926080000000002 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867156+0000", 2024-09-16T04:09:07.905 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8545000000000001e-05 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 36.96035689, 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012877899, 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.906 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.907 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857456+0000", 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.13e-06 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857497+0000", 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0889000000000001e-05 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.908 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857521+0000", 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3635999999999999e-05 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857630+0000", 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010979700000000001 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.909 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.860884+0000", 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032533760000000001 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.860915+0000", 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0966999999999997e-05 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870250+0000", 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093347870000000006 2024-09-16T04:09:07.910 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870333+0000", 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3317000000000002e-05 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.8s3 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:09:07.911 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 36.959958469999997, 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012440777, 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:09:07.912 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857854+0000", 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.006e-06 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857909+0000", 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4805999999999997e-05 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857933+0000", 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3468999999999998e-05 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.914 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857952+0000", 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9150000000000001e-05 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858117+0000", 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016526799999999999 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858143+0000", 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5887000000000001e-05 2024-09-16T04:09:07.915 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870197+0000", 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012053927000000001 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870294+0000", 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7263999999999996e-05 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.916 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:523 3.3s0 3:cd6753c4:::smithi20431790-18:head [copy-from ver 6] snapc 10=[f] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 21.619402045000001, 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014171206, 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.917 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 523 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.918 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198413+0000", 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8449999999999999e-06 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.919 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198434+0000", 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0877e-05 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198483+0000", 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9058999999999999e-05 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.920 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198500+0000", 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7456999999999999e-05 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198657+0000", 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000157069 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198968+0000", 2024-09-16T04:09:07.921 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00031080000000000002 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.208172+0000", 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092042619999999995 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.211163+0000", 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029903820000000002 2024-09-16T04:09:07.922 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.212391+0000", 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001228385 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.212581+0000", 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019007 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.923 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:524 3.3s0 3:cd6753c4:::smithi20431790-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 21.619274659999999, 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012231209, 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.924 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 524 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:09:07.925 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198538+0000", 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.237e-06 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198546+0000", 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7149999999999998e-06 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.926 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198572+0000", 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5746999999999999e-05 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198585+0000", 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3339999999999999e-05 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.199477+0000", 2024-09-16T04:09:07.927 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00089197600000000005 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.199599+0000", 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000122018 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210447+0000", 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010848116999999999 2024-09-16T04:09:07.928 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210634+0000", 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018665899999999999 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210768+0000", 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013439999999999999 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.929 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.8s3 74/69 ECSubWrite(tid=358, reqid=osd.10.0:358, at_version=74'41, trim_to=0'0, roll_forward_to=70'39))", 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.863091+0000", 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.954720657999999, 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011730251000000001, 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.863091+0000", 2024-09-16T04:09:07.930 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.863091+0000", 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.863092+0000", 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5600000000000005e-07 2024-09-16T04:09:07.931 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864536+0000", 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0014435979999999999 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867389+0000", 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028531950000000002 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.932 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867414+0000", 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5673e-05 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867576+0000", 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016150999999999999 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867600+0000", 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4533999999999999e-05 2024-09-16T04:09:07.933 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.874724+0000", 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00712314 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.874821+0000", 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7844999999999996e-05 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.934 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:769 3.3s0 3:c529a602:::smithi20431790-6:head [append 0~573440] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.294376+0000", 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.523436261000001, 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0088758199999999995, 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.935 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 769 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294376+0000", 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.936 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294376+0000", 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294377+0000", 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7659999999999999e-06 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294799+0000", 2024-09-16T04:09:07.937 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00042189000000000001 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294821+0000", 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1656999999999999e-05 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294844+0000", 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3039000000000001e-05 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.938 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294960+0000", 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000115982 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.295117+0000", 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000156914 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:07.939 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.296472+0000", 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013554019999999999 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298170+0000", 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001698123 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.303047+0000", 2024-09-16T04:09:07.940 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048763310000000002 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.303251+0000", 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000204716 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:772 3.3s0 3:c529a602:::smithi20431790-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:07.941 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.298679+0000", 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 10.519133069, 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010151774000000001, 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 772 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:07.942 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298679+0000", 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298679+0000", 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298680+0000", 2024-09-16T04:09:07.943 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4699999999999999e-06 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298688+0000", 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1629999999999996e-06 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298708+0000", 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9789999999999999e-05 2024-09-16T04:09:07.944 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298723+0000", 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.435e-05 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.304417+0000", 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056943899999999997 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.945 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.304547+0000", 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013039099999999999 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.305406+0000", 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00085826399999999997 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.305652+0000", 2024-09-16T04:09:07.946 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000246536 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.308831+0000", 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031784199999999999 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:07.947 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:07.948 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-16T04:09:07.949 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'unique_pool_0' removed 2024-09-16T04:09:07.950 INFO:tasks.ceph.osd.3.smithi204.stderr:2024-09-16T04:09:07.943+0000 7f0570bba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26630) UID: 0 2024-09-16T04:09:07.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T04:09:07.975 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-16T04:09:07.984 INFO:tasks.thrashosds:joining thrashosds 2024-09-16T04:09:08.072 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:09:08.072 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:08.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-16T04:09:08.204 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:08.204 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:08.205 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:09:08.205 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:09:08.205 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:08.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-16T04:09:08.345 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:180 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'130, mlcod=25'125)", 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 65.751825593999996, 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048385040000000004, 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.346 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590396+0000", 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590397+0000", 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590411+0000", 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4019000000000001e-05 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590437+0000", 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5604000000000001e-05 2024-09-16T04:09:08.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590471+0000", 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786999999999997e-05 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590878+0000", 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040631400000000001 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:08.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.590911+0000", 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595170+0000", 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042592050000000003 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.595234+0000", 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3921e-05 2024-09-16T04:09:08.350 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:182 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'132, mlcod=25'125)", 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 65.750911759000005, 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051456440000000004, 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591309+0000", 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591311+0000", 2024-09-16T04:09:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7439999999999999e-06 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591380+0000", 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8540000000000004e-05 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591407+0000", 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7830999999999998e-05 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591427+0000", 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9689000000000001e-05 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592031+0000", 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060361900000000001 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592059+0000", 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8603999999999999e-05 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596398+0000", 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043381060000000004 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596455+0000", 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7510999999999999e-05 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:183 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'133, mlcod=25'125)", 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 65.750409789000003, 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046844299999999998, 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591811+0000", 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591813+0000", 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5990000000000001e-06 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591827+0000", 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4012000000000001e-05 2024-09-16T04:09:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591851+0000", 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3785e-05 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.591867+0000", 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6184999999999998e-05 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592788+0000", 2024-09-16T04:09:08.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092107500000000004 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.592818+0000", 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0487000000000001e-05 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596460+0000", 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036418240000000001 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.596496+0000", 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5463000000000002e-05 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4260.0:185 1.0 e25/24 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'135, mlcod=25'126)", 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 65.749011287000002, 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004807703, 2024-09-16T04:09:08.360 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593210+0000", 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593211+0000", 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3599999999999999e-06 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593283+0000", 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1697000000000002e-05 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593310+0000", 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7427999999999999e-05 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.593326+0000", 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6121e-05 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594218+0000", 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089172399999999999 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.594251+0000", 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3093999999999999e-05 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.597952+0000", 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037006389999999999 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:02.598018+0000", 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5640000000000002e-05 2024-09-16T04:09:08.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.401642666000001, 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055770669999999998, 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940578+0000", 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940579+0000", 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7e-07 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940742+0000", 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343299999999999 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940766+0000", 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3288000000000001e-05 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940779+0000", 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3254999999999999e-05 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0068000000000007e-05 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940868+0000", 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8170000000000005e-06 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946112+0000", 2024-09-16T04:09:08.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052441359999999999 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946156+0000", 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3600000000000003e-05 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.401411602000003, 2024-09-16T04:09:08.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047930250000000002, 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:09:08.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940810+0000", 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940832+0000", 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1430999999999999e-05 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940851+0000", 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8941e-05 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940859+0000", 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9100000000000005e-06 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940937+0000", 2024-09-16T04:09:08.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8448999999999994e-05 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.940947+0000", 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.012e-05 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945554+0000", 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046069070000000004 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945603+0000", 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8401e-05 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.400690834999999, 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046535999999999999, 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.374 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941530+0000", 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941531+0000", 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.127e-06 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941561+0000", 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0011000000000001e-05 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941630+0000", 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8071999999999995e-05 2024-09-16T04:09:08.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941642+0000", 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2785e-05 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941714+0000", 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1396000000000006e-05 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.941729+0000", 2024-09-16T04:09:08.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5656999999999999e-05 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946160+0000", 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044310349999999998 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.946184+0000", 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3516999999999999e-05 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.488733769, 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049795229999999996, 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853487+0000", 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853488+0000", 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853542+0000", 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3414000000000001e-05 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853571+0000", 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9356000000000002e-05 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853593+0000", 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2022e-05 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853710+0000", 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011686199999999999 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.853729+0000", 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9042000000000002e-05 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.856355+0000", 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026263950000000001 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858467+0000", 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021115890000000001 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.486865234, 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060930639999999996, 2024-09-16T04:09:08.384 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855356+0000", 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5199999999999998e-07 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855382+0000", 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6024e-05 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855395+0000", 2024-09-16T04:09:08.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2721000000000001e-05 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.855403+0000", 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4849999999999992e-06 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858436+0000", 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003033011 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.858471+0000", 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4548999999999997e-05 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.861417+0000", 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002946228 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:30.861449+0000", 2024-09-16T04:09:08.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1794000000000001e-05 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 63/31 ECSubWrite(tid=130, reqid=client.4631.0:534, at_version=63'44, trim_to=0'0, roll_forward_to=63'42))", 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.387528+0000", 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.954693231, 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004958662, 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387528+0000", 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387528+0000", 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387555+0000", 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7285e-05 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387593+0000", 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7512999999999998e-05 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387614+0000", 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1375000000000001e-05 2024-09-16T04:09:08.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387628+0000", 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3427e-05 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387753+0000", 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125943 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.387768+0000", 2024-09-16T04:09:08.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4136e-05 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.392361+0000", 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045937729999999998 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.392487+0000", 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012521 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 64/31 ECSubWrite(tid=136, reqid=osd.13.0:136, at_version=64'48, trim_to=0'0, roll_forward_to=63'46))", 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.904491+0000", 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.437729839999999, 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048433909999999998, 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904491+0000", 2024-09-16T04:09:08.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904491+0000", 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904493+0000", 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.708e-06 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904524+0000", 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0725999999999997e-05 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904549+0000", 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5117999999999999e-05 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904561+0000", 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1864e-05 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904651+0000", 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.904665+0000", 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.473e-05 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.909290+0000", 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046243029999999997 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.909335+0000", 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5065999999999998e-05 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 74/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=74'59, trim_to=0'0, roll_forward_to=73'57))", 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:56.858533+0000", 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 11.483688000000001, 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005141662, 2024-09-16T04:09:08.398 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858533+0000", 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858533+0000", 2024-09-16T04:09:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858533+0000", 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7000000000000001e-07 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858566+0000", 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2292999999999997e-05 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858583+0000", 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6969999999999998e-05 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858596+0000", 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3823e-05 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858721+0000", 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012483199999999999 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858766+0000", 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4224999999999998e-05 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.863616+0000", 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004850226 2024-09-16T04:09:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.863675+0000", 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9023000000000001e-05 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 79/31 ECSubWrite(tid=206, reqid=osd.13.0:206, at_version=79'69, trim_to=0'0, roll_forward_to=78'67))", 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.886318+0000", 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.455902676, 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065475150000000003, 2024-09-16T04:09:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886318+0000", 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886318+0000", 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886319+0000", 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0999999999999998e-07 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886394+0000", 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5382000000000004e-05 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886419+0000", 2024-09-16T04:09:08.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4493000000000001e-05 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886442+0000", 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3206000000000001e-05 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886624+0000", 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018197999999999999 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886657+0000", 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3249e-05 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.892774+0000", 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061166770000000001 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.892866+0000", 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1917999999999996e-05 2024-09-16T04:09:08.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 79/31 ECSubWrite(tid=208, reqid=osd.13.0:208, at_version=79'71, trim_to=0'0, roll_forward_to=78'67))", 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.889253+0000", 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4529683599999998, 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050374189999999996, 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889253+0000", 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889253+0000", 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889255+0000", 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.863e-06 2024-09-16T04:09:08.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889356+0000", 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100988 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889388+0000", 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2580000000000003e-05 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889410+0000", 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1636000000000001e-05 2024-09-16T04:09:08.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889879+0000", 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046961700000000003 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889903+0000", 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3873e-05 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.894203+0000", 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042993739999999999 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.894290+0000", 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7488e-05 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s2 79/69 ECSubWrite(tid=407, reqid=osd.10.0:407, at_version=79'47, trim_to=0'0, roll_forward_to=78'45))", 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.893866+0000", 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4483550479999998, 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083679129999999994, 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893866+0000", 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893866+0000", 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893867+0000", 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0999999999999997e-07 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893922+0000", 2024-09-16T04:09:08.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4704999999999999e-05 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893954+0000", 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2255999999999997e-05 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893977+0000", 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3232999999999999e-05 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895061+0000", 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083627 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895086+0000", 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4987e-05 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.902148+0000", 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070626300000000003 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.902234+0000", 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5564999999999998e-05 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es5 79/31 ECSubWrite(tid=89, reqid=osd.8.0:89, at_version=79'65, trim_to=0'0, roll_forward_to=77'63))", 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.896917+0000", 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4453042050000002, 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072318299999999999, 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.417 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896917+0000", 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896917+0000", 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896918+0000", 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9699999999999996e-07 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896967+0000", 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9412000000000001e-05 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897011+0000", 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3705999999999998e-05 2024-09-16T04:09:08.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897035+0000", 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3998999999999998e-05 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897224+0000", 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018892900000000001 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897248+0000", 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4117e-05 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904048+0000", 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006800586 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904149+0000", 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100484 2024-09-16T04:09:08.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as6 79/31 ECSubWrite(tid=210, reqid=osd.13.0:208, at_version=0'0, trim_to=0'0, roll_forward_to=79'71))", 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.901349+0000", 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4408726099999996, 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065719339999999998, 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901349+0000", 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901349+0000", 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901351+0000", 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.17e-06 2024-09-16T04:09:08.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901381+0000", 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0436000000000001e-05 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901424+0000", 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2565000000000003e-05 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901449+0000", 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4913999999999999e-05 2024-09-16T04:09:08.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901615+0000", 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016617199999999999 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.901639+0000", 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4600000000000002e-05 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.907812+0000", 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061730159999999999 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.907920+0000", 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010806099999999999 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es5 79/31 ECSubWrite(tid=90, reqid=osd.8.0:89, at_version=0'0, trim_to=0'0, roll_forward_to=79'65))", 2024-09-16T04:09:08.426 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.909043+0000", 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4331782799999999, 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048021540000000003, 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909043+0000", 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909043+0000", 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909045+0000", 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909077+0000", 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2252999999999998e-05 2024-09-16T04:09:08.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909150+0000", 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2805000000000005e-05 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909176+0000", 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6590000000000001e-05 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909401+0000", 2024-09-16T04:09:08.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000224191 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909427+0000", 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6132999999999999e-05 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.913791+0000", 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043646129999999998 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.913845+0000", 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3582000000000003e-05 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 79/31 ECSubWrite(tid=412, reqid=osd.10.0:412, at_version=79'133, trim_to=0'0, roll_forward_to=77'131))", 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.916879+0000", 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4253425000000002, 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046549119999999998, 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916879+0000", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916879+0000", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916880+0000", 2024-09-16T04:09:08.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7300000000000004e-07 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916909+0000", 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9019000000000001e-05 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916928+0000", 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9826e-05 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916939+0000", 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0516999999999999e-05 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.917141+0000", 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020180099999999999 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.917170+0000", 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9436000000000001e-05 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.921448+0000", 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042774980000000002 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.921534+0000", 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5841999999999996e-05 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.4s6 79/31 ECSubWrite(tid=420, reqid=client.4631.0:840, at_version=79'139, trim_to=0'0, roll_forward_to=79'137))", 2024-09-16T04:09:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.107424+0000", 2024-09-16T04:09:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.2347969939999999, 2024-09-16T04:09:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050314909999999999, 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.107424+0000", 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.107424+0000", 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.107427+0000", 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.463e-06 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.108027+0000", 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00060055799999999995 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.108065+0000", 2024-09-16T04:09:08.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7799999999999997e-05 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.108095+0000", 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9543000000000002e-05 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.108291+0000", 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019655900000000001 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.108316+0000", 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5417000000000001e-05 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.112356+0000", 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040397360000000004 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.112456+0000", 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9414999999999996e-05 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.440 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.441 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.441 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:08.442 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-16T04:09:08.570 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:09:08.570 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:08.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-16T04:09:08.703 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:08.704 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:08.704 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:09:08.704 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:09:08.704 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:08.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.9s3 39/31 ECSubWrite(tid=20, reqid=client.4631.0:188, at_version=39'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:09:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.840033650000002, 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040184299999999999, 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998266+0000", 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2300000000000001e-07 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998524+0000", 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000257564 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998556+0000", 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990999999999999e-05 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998574+0000", 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7768999999999999e-05 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998779+0000", 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020545399999999999 2024-09-16T04:09:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998807+0000", 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7620999999999999e-05 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002192+0000", 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033852890000000001 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002284+0000", 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2119000000000004e-05 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 59/31 ECSubWrite(tid=87, reqid=client.4631.0:469, at_version=59'30, trim_to=0'0, roll_forward_to=57'26))", 2024-09-16T04:09:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:41.861444+0000", 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.976854899999999, 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038315290000000002, 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861444+0000", 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861444+0000", 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861446+0000", 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.404e-06 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861493+0000", 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7317000000000001e-05 2024-09-16T04:09:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861518+0000", 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5066999999999999e-05 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861532+0000", 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3702e-05 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861628+0000", 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5650999999999996e-05 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.861646+0000", 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8264999999999999e-05 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865225+0000", 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035794749999999999 2024-09-16T04:09:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:41.865276+0000", 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0648e-05 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 63/31 ECSubWrite(tid=110, reqid=client.4631.0:509, at_version=63'54, trim_to=0'0, roll_forward_to=63'53))", 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.176492+0000", 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.661807033999999, 2024-09-16T04:09:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057347099999999996, 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.176492+0000", 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.176492+0000", 2024-09-16T04:09:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.176496+0000", 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4759999999999998e-06 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178480+0000", 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019841189999999999 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178518+0000", 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8482000000000002e-05 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178537+0000", 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8892000000000001e-05 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178731+0000", 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019350500000000001 2024-09-16T04:09:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178756+0000", 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5686000000000001e-05 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.182095+0000", 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033381470000000001 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.182227+0000", 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013240300000000001 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 74/31 ECSubWrite(tid=183, reqid=osd.13.0:183, at_version=74'45, trim_to=0'0, roll_forward_to=73'43))", 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:56.858877+0000", 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 11.979422294999999, 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045250289999999999, 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858877+0000", 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858877+0000", 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858877+0000", 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1e-07 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858908+0000", 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0720999999999999e-05 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858949+0000", 2024-09-16T04:09:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1242999999999998e-05 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.858968+0000", 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8396000000000001e-05 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.859215+0000", 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024732999999999998 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.859241+0000", 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6143e-05 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.863350+0000", 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041088540000000003 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:56.863402+0000", 2024-09-16T04:09:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2031999999999999e-05 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 75/31 ECSubWrite(tid=189, reqid=osd.13.0:189, at_version=75'49, trim_to=0'0, roll_forward_to=74'47))", 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.867676+0000", 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.970623646, 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047669729999999999, 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867676+0000", 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867676+0000", 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867676+0000", 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5699999999999998e-07 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867730+0000", 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3922000000000003e-05 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867760+0000", 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0493000000000001e-05 2024-09-16T04:09:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867782+0000", 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1135999999999999e-05 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867899+0000", 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117027 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.867915+0000", 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5965999999999999e-05 2024-09-16T04:09:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.872390+0000", 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044757199999999999 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.872443+0000", 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2352000000000003e-05 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 79/31 ECSubWrite(tid=207, reqid=osd.13.0:207, at_version=79'61, trim_to=0'0, roll_forward_to=77'59))", 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.886684+0000", 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9516154339999998, 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011525166999999999, 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886684+0000", 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886684+0000", 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886685+0000", 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2699999999999999e-07 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886733+0000", 2024-09-16T04:09:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8121999999999998e-05 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886772+0000", 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9026000000000002e-05 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.886798+0000", 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5992000000000001e-05 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.887073+0000", 2024-09-16T04:09:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000275085 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.887100+0000", 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7342999999999999e-05 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.898154+0000", 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01105425 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.898209+0000", 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4622e-05 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 79/31 ECSubWrite(tid=209, reqid=osd.13.0:209, at_version=79'63, trim_to=0'0, roll_forward_to=77'59))", 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.888930+0000", 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9493695869999996, 2024-09-16T04:09:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010242777999999999, 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888930+0000", 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888930+0000", 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888932+0000", 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.776e-06 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888983+0000", 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1326000000000003e-05 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889024+0000", 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0929000000000001e-05 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889045+0000", 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1342999999999999e-05 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889262+0000", 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217102 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.889289+0000", 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6346000000000002e-05 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.899109+0000", 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098205919999999995 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.899173+0000", 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3363999999999998e-05 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s6 79/69 ECSubWrite(tid=407, reqid=osd.10.0:407, at_version=79'47, trim_to=0'0, roll_forward_to=78'45))", 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.893768+0000", 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9445309169999998, 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013544842, 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893768+0000", 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893768+0000", 2024-09-16T04:09:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893770+0000", 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2699999999999999e-06 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893829+0000", 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9757999999999999e-05 2024-09-16T04:09:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896291+0000", 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024610830000000002 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896321+0000", 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0071999999999999e-05 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896568+0000", 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024708899999999998 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896884+0000", 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031655300000000002 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.907114+0000", 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010229795 2024-09-16T04:09:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.907313+0000", 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019922200000000001 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 79/31 ECSubWrite(tid=164, reqid=osd.5.0:164, at_version=79'73, trim_to=0'0, roll_forward_to=77'71))", 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.895954+0000", 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9423453789999998, 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007695833, 2024-09-16T04:09:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895954+0000", 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895954+0000", 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895955+0000", 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9999999999999997e-07 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896004+0000", 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9744999999999999e-05 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896038+0000", 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3723000000000002e-05 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896061+0000", 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3465999999999999e-05 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896307+0000", 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024534099999999999 2024-09-16T04:09:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896331+0000", 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.44e-05 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.903546+0000", 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007214687 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.903650+0000", 2024-09-16T04:09:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103871 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 79/31 ECSubWrite(tid=89, reqid=osd.8.0:89, at_version=79'65, trim_to=0'0, roll_forward_to=77'63))", 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.897284+0000", 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9410156540000001, 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099419910000000007, 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897284+0000", 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897284+0000", 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897284+0000", 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6000000000000003e-07 2024-09-16T04:09:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897366+0000", 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1555000000000001e-05 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897397+0000", 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1022999999999998e-05 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897423+0000", 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6006000000000001e-05 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897650+0000", 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000227125 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897675+0000", 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4973e-05 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.907116+0000", 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094407610000000006 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.907226+0000", 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109788 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.fs2 79/31 ECSubWrite(tid=211, reqid=osd.13.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=79'63))", 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.904639+0000", 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9336602689999998, 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043672859999999997, 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904639+0000", 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904639+0000", 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904642+0000", 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8059999999999999e-06 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904672+0000", 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0133000000000001e-05 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904709+0000", 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6551999999999998e-05 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904732+0000", 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3703999999999999e-05 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904983+0000", 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025122099999999999 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905008+0000", 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4153000000000001e-05 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.908576+0000", 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035684459999999999 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909006+0000", 2024-09-16T04:09:08.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043027099999999997 2024-09-16T04:09:08.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.898 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.898 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 79/31 ECSubWrite(tid=79, reqid=osd.15.0:79, at_version=79'52, trim_to=0'0, roll_forward_to=77'50))", 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.905829+0000", 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9324705269999995, 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062360940000000002, 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905829+0000", 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905829+0000", 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905829+0000", 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4000000000000001e-07 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905882+0000", 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2371999999999999e-05 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905908+0000", 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5735999999999999e-05 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905929+0000", 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1766000000000001e-05 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.906432+0000", 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050292700000000002 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.906458+0000", 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5839000000000001e-05 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.911936+0000", 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054783970000000003 2024-09-16T04:09:08.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.912065+0000", 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128417 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.8s6 79/69 ECSubWrite(tid=410, reqid=osd.10.0:407, at_version=0'0, trim_to=0'0, roll_forward_to=79'47))", 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.909185+0000", 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9291147999999998, 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061594620000000001, 2024-09-16T04:09:08.903 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909185+0000", 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909185+0000", 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909186+0000", 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2640000000000001e-06 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909200+0000", 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.411e-05 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909216+0000", 2024-09-16T04:09:08.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5976000000000001e-05 2024-09-16T04:09:08.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909227+0000", 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1233000000000001e-05 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909841+0000", 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061355000000000003 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909866+0000", 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4936e-05 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915251+0000", 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053856319999999996 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915344+0000", 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2761000000000002e-05 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.es2 79/31 ECSubWrite(tid=90, reqid=osd.8.0:89, at_version=0'0, trim_to=0'0, roll_forward_to=79'65))", 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.909441+0000", 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9288584889999996, 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046978899999999997, 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909441+0000", 2024-09-16T04:09:08.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909441+0000", 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909443+0000", 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4370000000000001e-06 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909475+0000", 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1792999999999999e-05 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909508+0000", 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2465999999999997e-05 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909570+0000", 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2471999999999994e-05 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909771+0000", 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200979 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.909796+0000", 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5426e-05 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.914046+0000", 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042499549999999997 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.914139+0000", 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2361999999999994e-05 2024-09-16T04:09:08.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 79/31 ECSubWrite(tid=80, reqid=osd.15.0:79, at_version=0'0, trim_to=0'0, roll_forward_to=79'52))", 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.913980+0000", 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9243194800000003, 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053294340000000001, 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.915 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.913980+0000", 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.913980+0000", 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.913981+0000", 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4589999999999999e-06 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.913997+0000", 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5242000000000001e-05 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.914013+0000", 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.914024+0000", 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0730000000000001e-05 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.914181+0000", 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015735200000000001 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.914210+0000", 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8503000000000001e-05 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.919207+0000", 2024-09-16T04:09:08.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049970329999999997 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.919309+0000", 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102532 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 79/31 ECSubWrite(tid=166, reqid=osd.5.0:164, at_version=0'0, trim_to=0'0, roll_forward_to=79'73))", 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.915375+0000", 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.9229246949999999, 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046019880000000004, 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915375+0000", 2024-09-16T04:09:08.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915375+0000", 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915376+0000", 2024-09-16T04:09:08.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.686e-06 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915403+0000", 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6599999999999999e-05 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915443+0000", 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9888999999999997e-05 2024-09-16T04:09:08.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915463+0000", 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0213000000000001e-05 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915644+0000", 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018076299999999999 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915667+0000", 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2869000000000001e-05 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.919889+0000", 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042223870000000002 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.919977+0000", 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7581000000000001e-05 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 79/31 ECSubWrite(tid=177, reqid=client.4631.0:888, at_version=79'81, trim_to=0'0, roll_forward_to=79'79))", 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.368318+0000", 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4699816090000004, 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057346330000000003, 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.926 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368318+0000", 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368318+0000", 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368319+0000", 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7269999999999999e-06 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368362+0000", 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2595000000000001e-05 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368394+0000", 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2366000000000001e-05 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368411+0000", 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6257e-05 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368575+0000", 2024-09-16T04:09:08.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016449300000000001 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.368595+0000", 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0139000000000001e-05 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.373962+0000", 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005366984 2024-09-16T04:09:08.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.374052+0000", 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0072000000000001e-05 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs4 79/31 ECSubWrite(tid=178, reqid=client.4631.0:889, at_version=79'82, trim_to=0'0, roll_forward_to=79'79))", 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.371956+0000", 2024-09-16T04:09:08.931 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.4663437339999996, 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004757832, 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.371956+0000", 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.371956+0000", 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.371957+0000", 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.776e-06 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.371993+0000", 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6099000000000001e-05 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.372023+0000", 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9592999999999999e-05 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.372039+0000", 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5829999999999999e-05 2024-09-16T04:09:08.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.372191+0000", 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015198699999999999 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.372206+0000", 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5440000000000001e-05 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.376659+0000", 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004453098 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.376713+0000", 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4008999999999997e-05 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 79/31 ECSubWrite(tid=81, reqid=client.4631.0:907, at_version=79'54, trim_to=0'0, roll_forward_to=79'52))", 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.644340+0000", 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.1939594490000003, 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046827709999999996, 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644340+0000", 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644340+0000", 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644343+0000", 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.05e-06 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644385+0000", 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1638999999999999e-05 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644417+0000", 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2855999999999998e-05 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644434+0000", 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6167e-05 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644631+0000", 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019790899999999999 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.644651+0000", 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-05 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.648936+0000", 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042844179999999999 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.649023+0000", 2024-09-16T04:09:08.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6891999999999994e-05 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.3s4 79/31 ECSubWrite(tid=83, reqid=client.4631.0:922, at_version=79'56, trim_to=0'0, roll_forward_to=79'54))", 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.657160+0000", 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.1811390250000002, 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044994309999999999, 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:08.942 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657160+0000", 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657160+0000", 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657162+0000", 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657388+0000", 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022565500000000001 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657429+0000", 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0862999999999998e-05 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657452+0000", 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3186000000000001e-05 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657631+0000", 2024-09-16T04:09:08.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000178763 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.657652+0000", 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1379999999999999e-05 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.661570+0000", 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039179260000000004 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:08.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.661660+0000", 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9808000000000005e-05 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:08.947 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:08.947 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-16T04:09:08.947 INFO:tasks.thrashosds.thrasher:Adding osd 8 2024-09-16T04:09:08.948 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 8 2024-09-16T04:09:08.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-16T04:09:08.954 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-16T04:09:09.071 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:09.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:09.071 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:09:09.071 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:09.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-16T04:09:09.201 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:09:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:09:09.201 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:09.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-16T04:09:09.267 INFO:tasks.ceph.mon.b.smithi050.stderr:2024-09-16T04:09:09.263+0000 7f36ccf76640 -1 mon.b@1(leader).osd e86 definitely_dead 0 2024-09-16T04:09:09.351 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:09:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:09:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:09:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:4 3.es0 3:7eb60d01:::smithi20431790-2:head [append 0~32768,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.414688976999997, 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013185643, 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 4 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932525+0000", 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932527+0000", 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8419999999999999e-06 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932624+0000", 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6569000000000003e-05 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932639+0000", 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5235000000000001e-05 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932649+0000", 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9170000000000001e-06 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932741+0000", 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2386999999999995e-05 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932935+0000", 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019349300000000001 2024-09-16T04:09:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.933686+0000", 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000751397 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935325+0000", 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016391139999999999 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945629+0000", 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010304015999999999 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.945711+0000", 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1673000000000002e-05 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:5 3.es0 3:7eb60d01:::smithi20431790-2:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.414537015999997, 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023042435, 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 5 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932677+0000", 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932678+0000", 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3900000000000005e-07 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932681+0000", 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9380000000000001e-06 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932688+0000", 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0190000000000001e-06 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932693+0000", 2024-09-16T04:09:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0470000000000001e-06 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934299+0000", 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016061459999999999 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934403+0000", 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104053 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.934949+0000", 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054629899999999998 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.937424+0000", 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024750050000000002 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955463+0000", 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018038200000000001 2024-09-16T04:09:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.955720+0000", 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025718900000000001 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:6 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.414492531, 2024-09-16T04:09:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033670261999999999, 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 6 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932722+0000", 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.15e-07 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932731+0000", 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5450000000000003e-06 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932738+0000", 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7630000000000003e-06 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.932743+0000", 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.13e-06 2024-09-16T04:09:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935222+0000", 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002479621 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.935313+0000", 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0717999999999994e-05 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956695+0000", 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021382437000000001 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.956983+0000", 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028708299999999999 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966392+0000", 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094095499999999992 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:139 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~786432,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.271491337, 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067777820000000004, 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075723+0000", 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.075725+0000", 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.807e-06 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077516+0000", 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017915439999999999 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077542+0000", 2024-09-16T04:09:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6095999999999999e-05 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077554+0000", 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1092e-05 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077624+0000", 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9941e-05 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077802+0000", 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017843199999999999 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.079111+0000", 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00130955 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081291+0000", 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00217986 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082420+0000", 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001128642 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.082501+0000", 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0817999999999998e-05 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.374 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:141 3.es0 3:7eff5f99:::smithi20431790-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.269596135999997, 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077419300000000002, 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077618+0000", 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077619+0000", 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1200000000000003e-07 2024-09-16T04:09:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077622+0000", 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5599999999999998e-06 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077630+0000", 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7719999999999994e-06 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.077636+0000", 2024-09-16T04:09:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4689999999999996e-06 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081205+0000", 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003569773 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081284+0000", 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8584000000000005e-05 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.083920+0000", 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026361890000000002 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.084003+0000", 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2714999999999997e-05 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.085360+0000", 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013573560000000001 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:506 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~2637824,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.159225+0000", 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.18798911, 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013121979000000001, 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 506 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159225+0000", 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159225+0000", 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159229+0000", 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.63e-06 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159249+0000", 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0193000000000001e-05 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159287+0000", 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7945999999999999e-05 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159307+0000", 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9695e-05 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159513+0000", 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020604799999999999 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159831+0000", 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031844799999999998 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172347+0000", 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012516019 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:507 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~2637824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.187852843000002, 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015605647, 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-16T04:09:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159362+0000", 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5600000000000004e-07 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159388+0000", 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5321e-05 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159401+0000", 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2746e-05 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159408+0000", 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1300000000000003e-06 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.161079+0000", 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016716089999999999 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.161364+0000", 2024-09-16T04:09:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028476800000000002 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.174967+0000", 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013603117 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:508 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~2637824,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.159463+0000", 2024-09-16T04:09:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.187751234, 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018372958000000002, 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 508 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159463+0000", 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159463+0000", 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159464+0000", 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2800000000000005e-07 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159481+0000", 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7280000000000001e-05 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159496+0000", 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4966999999999999e-05 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.159503+0000", 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0380000000000002e-06 2024-09-16T04:09:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.162481+0000", 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029773209999999998 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.162631+0000", 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014984199999999999 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.177836+0000", 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015205582 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpReadReply(3.es0 63/31 ECSubReadReply(tid=52, attrs_read=0))", 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:46.171161+0000", 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.176053611, 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068944330000000002, 2024-09-16T04:09:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171161+0000", 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171161+0000", 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.171162+0000", 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1629999999999999e-06 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172065+0000", 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00090283799999999999 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172090+0000", 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5579999999999999e-05 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.172106+0000", 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5843000000000001e-05 2024-09-16T04:09:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.175165+0000", 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030583709999999998 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:46.178055+0000", 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028906380000000001 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:556 3.es0 3:7eb60d01:::smithi20431790-2:head [setxattr _header (56) in=7b] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.019448+0000", 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.327766286999999, 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085764510000000006, 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 556 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019448+0000", 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019448+0000", 2024-09-16T04:09:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019449+0000", 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3300000000000002e-07 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019451+0000", 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1720000000000001e-06 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019455+0000", 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3800000000000004e-06 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019458+0000", 2024-09-16T04:09:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0989999999999999e-06 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.022961+0000", 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035028239999999999 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.023114+0000", 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015293899999999999 2024-09-16T04:09:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.023706+0000", 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059239899999999996 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024443+0000", 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073647000000000003 2024-09-16T04:09:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.027948+0000", 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003504708 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.028025+0000", 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6927000000000004e-05 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:557 3.es0 3:7eb60d01:::smithi20431790-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:47.019462+0000", 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.327751879000001, 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010162885999999999, 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 557 2024-09-16T04:09:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019462+0000", 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019462+0000", 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019463+0000", 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.84e-07 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019464+0000", 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1990000000000001e-06 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019468+0000", 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1969999999999998e-06 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.019472+0000", 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9450000000000003e-06 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.023993+0000", 2024-09-16T04:09:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045205260000000004 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.024085+0000", 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1988000000000001e-05 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.028323+0000", 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042385749999999996 2024-09-16T04:09:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.028408+0000", 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4679999999999996e-05 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:47.029625+0000", 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012174919999999999 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:773 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~622592] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.303313+0000", 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.043900943000001, 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010789702, 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 773 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.303313+0000", 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.303313+0000", 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.303317+0000", 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8929999999999998e-06 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.304706+0000", 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00138842 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.304740+0000", 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4396000000000001e-05 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.304757+0000", 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7070000000000001e-05 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.304906+0000", 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014916699999999999 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.305059+0000", 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152979 2024-09-16T04:09:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.306814+0000", 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017546549999999999 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.309270+0000", 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024555670000000001 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.313869+0000", 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045994499999999997 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314103+0000", 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000234105 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:774 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~655360] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.308101+0000", 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.039113744, 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010885850000000001, 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 774 2024-09-16T04:09:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.308101+0000", 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.308101+0000", 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.308103+0000", 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.309347+0000", 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001244293 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.309388+0000", 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0145000000000003e-05 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.309408+0000", 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0244000000000001e-05 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.309550+0000", 2024-09-16T04:09:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014249999999999999 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.309850+0000", 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000299726 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.311731+0000", 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018807489999999999 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314373+0000", 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00264197 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.318871+0000", 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044978190000000001 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.318986+0000", 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115857 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:775 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~688128] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.313059+0000", 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.034155272, 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011300618, 2024-09-16T04:09:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 775 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.313059+0000", 2024-09-16T04:09:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.313059+0000", 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.313061+0000", 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3269999999999999e-06 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314820+0000", 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017589050000000001 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314846+0000", 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5653e-05 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314859+0000", 2024-09-16T04:09:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2679e-05 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315021+0000", 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016252700000000001 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315241+0000", 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021988899999999999 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.316847+0000", 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001606351 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.323578+0000", 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006730654 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.324218+0000", 2024-09-16T04:09:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064013999999999998 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.324360+0000", 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141493 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:776 3.es0 3:7eff5f99:::smithi20431790-47:head [append 0~212992] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.314885+0000", 2024-09-16T04:09:09.430 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.032329161, 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010523744999999999, 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 776 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314885+0000", 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314885+0000", 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.314886+0000", 2024-09-16T04:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.22e-06 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315025+0000", 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013864300000000001 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315040+0000", 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5406000000000001e-05 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315050+0000", 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2869999999999993e-06 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.319359+0000", 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043089299999999999 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.319559+0000", 2024-09-16T04:09:09.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020042899999999999 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.320645+0000", 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010855999999999999 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.323915+0000", 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032705820000000002 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.325240+0000", 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001324921 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.325409+0000", 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000168727 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:777 3.es0 3:7eff5f99:::smithi20431790-47:head [setxattr _header (57) in=7b] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:09.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.315070+0000", 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.032144068999999, 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011129585000000001, 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 777 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315070+0000", 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315070+0000", 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315071+0000", 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6700000000000002e-07 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315078+0000", 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2729999999999999e-06 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315088+0000", 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0339999999999999e-05 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315095+0000", 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2429999999999999e-06 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.321747+0000", 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066515560000000003 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.321972+0000", 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022573800000000001 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.323110+0000", 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011377760000000001 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.324572+0000", 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014620849999999999 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.326102+0000", 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015296159999999999 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.326200+0000", 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7991000000000004e-05 2024-09-16T04:09:09.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:778 3.es0 3:7eff5f99:::smithi20431790-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:57.315106+0000", 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.032107919, 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015131374, 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 778 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315106+0000", 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315106+0000", 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315107+0000", 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5600000000000005e-07 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315111+0000", 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5439999999999999e-06 2024-09-16T04:09:09.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315121+0000", 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.315129+0000", 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5789999999999998e-06 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.326889+0000", 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011760224999999999 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.327130+0000", 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241155 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:57.330238+0000", 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003107482 2024-09-16T04:09:09.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.as4 79/31 ECSubWrite(tid=208, reqid=osd.13.0:208, at_version=79'71, trim_to=0'0, roll_forward_to=78'67))", 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.888692+0000", 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.4585227730000003, 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080912989999999997, 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.448 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888692+0000", 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888692+0000", 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888694+0000", 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888748+0000", 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4792e-05 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888780+0000", 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1572999999999997e-05 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.888803+0000", 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2663e-05 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.890193+0000", 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013905479999999999 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.890228+0000", 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4842000000000003e-05 2024-09-16T04:09:09.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896687+0000", 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064590999999999997 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896783+0000", 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5841000000000006e-05 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.bs4 79/31 ECSubWrite(tid=408, reqid=osd.10.0:408, at_version=79'183, trim_to=0'0, roll_forward_to=77'181))", 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.894939+0000", 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.4522748959999996, 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092102529999999998, 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.894939+0000", 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.894939+0000", 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.894940+0000", 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2699999999999999e-07 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.894987+0000", 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6595999999999999e-05 2024-09-16T04:09:09.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895017+0000", 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9981999999999999e-05 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895039+0000", 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2103000000000002e-05 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895278+0000", 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023933200000000001 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895308+0000", 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9485999999999999e-05 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904061+0000", 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087533960000000001 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904150+0000", 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8630999999999999e-05 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.5s6 79/31 ECSubWrite(tid=165, reqid=osd.5.0:165, at_version=79'40, trim_to=0'0, roll_forward_to=78'36))", 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.897109+0000", 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.4501051040000004, 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075780800000000001, 2024-09-16T04:09:09.459 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897109+0000", 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897109+0000", 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897111+0000", 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.933e-06 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897183+0000", 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1902000000000004e-05 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897209+0000", 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6270000000000001e-05 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897232+0000", 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2991999999999999e-05 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.898119+0000", 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088660900000000001 2024-09-16T04:09:09.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.898141+0000", 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1895999999999998e-05 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904603+0000", 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064621189999999997 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.904687+0000", 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4358999999999996e-05 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.464 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:09.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-16T04:09:09.595 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-16T04:09:09.595 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:09.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-16T04:09:09.732 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:09.733 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-16T04:09:09.733 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-16T04:09:09.733 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-16T04:09:09.733 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:09.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:31 3.9s0 3:93634e21:::smithi20431790-11:head [append 0~180224,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:09:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.920001675000002, 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015779225000000001, 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 31 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947685+0000", 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.947688+0000", 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.599e-06 2024-09-16T04:09:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948028+0000", 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000340491 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948040+0000", 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1488000000000001e-05 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948046+0000", 2024-09-16T04:09:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948165+0000", 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011934000000000001 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948369+0000", 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020333999999999999 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.949522+0000", 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001153435 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951355+0000", 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001833386 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963404+0000", 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012048644000000001 2024-09-16T04:09:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963464+0000", 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0044999999999999e-05 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:32 3.9s0 3:93634e21:::smithi20431790-11:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.919618984000003, 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015702510999999999, 2024-09-16T04:09:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 32 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948068+0000", 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2600000000000002e-07 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948073+0000", 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6700000000000002e-06 2024-09-16T04:09:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948082+0000", 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.85e-06 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948090+0000", 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9729999999999997e-06 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950170+0000", 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020803670000000001 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950297+0000", 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127062 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.950926+0000", 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062826500000000003 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951904+0000", 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000978694 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963618+0000", 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011714096 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.963770+0000", 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015180799999999999 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:33 3.9s0 3:93634e21:::smithi20431790-11:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.919563050999997, 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018249636999999999, 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 33 2024-09-16T04:09:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948124+0000", 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948125+0000", 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.159e-06 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948130+0000", 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5559999999999998e-06 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948145+0000", 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5057e-05 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.948155+0000", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7040000000000006e-06 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951232+0000", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003077069 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.951336+0000", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000103558 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964171+0000", 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012834887999999999 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.964283+0000", 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112611 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:16.966373+0000", 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020900350000000001 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:120 3.0s0 3:04de99e5:::smithi20431790-40:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.824864603000002, 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091318960000000005, 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 120 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042822+0000", 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042823+0000", 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0699999999999997e-07 2024-09-16T04:09:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042825+0000", 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.441e-06 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042834+0000", 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4099999999999997e-06 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.042840+0000", 2024-09-16T04:09:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.728e-06 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045635+0000", 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027951059999999999 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.045745+0000", 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109392 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050479+0000", 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047341659999999997 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.050579+0000", 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9852999999999994e-05 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.051954+0000", 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013752930000000001 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:138 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.795866451000002, 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098477340000000003, 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-16T04:09:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071820+0000", 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071821+0000", 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0399999999999996e-07 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071824+0000", 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9639999999999999e-06 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071833+0000", 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7879999999999995e-06 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.071839+0000", 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9959999999999999e-06 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074071+0000", 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022326329999999999 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.074173+0000", 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101989 2024-09-16T04:09:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078912+0000", 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047384030000000004 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.078998+0000", 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6192000000000004e-05 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:17.081668+0000", 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002670165 2024-09-16T04:09:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:188 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~589824] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.877397926, 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016933011000000001, 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 188 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990289+0000", 2024-09-16T04:09:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.990292+0000", 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9330000000000001e-06 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991612+0000", 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001319888 2024-09-16T04:09:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991650+0000", 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8581999999999998e-05 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991668+0000", 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8051999999999999e-05 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991865+0000", 2024-09-16T04:09:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000196403 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.991887+0000", 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2492000000000001e-05 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995547+0000", 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036596369999999999 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.995693+0000", 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146136 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.998906+0000", 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032132800000000002 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005918+0000", 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070119850000000001 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007080+0000", 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001161673 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007222+0000", 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014195000000000001 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:189 3.9s0 3:9410ed93:::smithi20431790-37:head [append 0~376832] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.871119448000002, 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012452869, 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 189 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996567+0000", 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.996570+0000", 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.756e-06 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997415+0000", 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00084544299999999998 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997456+0000", 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0561e-05 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997484+0000", 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8129000000000001e-05 2024-09-16T04:09:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000795+0000", 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033113959999999999 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.000996+0000", 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020074599999999999 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.002809+0000", 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018127729999999999 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005921+0000", 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003112489 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.008866+0000", 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029447100000000001 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009020+0000", 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015386600000000001 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:190 3.9s0 3:9410ed93:::smithi20431790-37:head [setxattr _header (56) in=7b] snapc 5=[5,4,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.870157132000003, 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012174411, 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 190 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997529+0000", 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997531+0000", 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-06 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997540+0000", 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999999e-06 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997567+0000", 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7121e-05 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997598+0000", 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.003915+0000", 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006316627 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.004057+0000", 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141512 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.005216+0000", 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011591800000000001 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.006552+0000", 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001335955 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009553+0000", 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030017009999999998 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.009704+0000", 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015053199999999999 2024-09-16T04:09:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:191 3.9s0 3:9410ed93:::smithi20431790-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.870038931000003, 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015318632, 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 191 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997648+0000", 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997649+0000", 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.533e-06 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997657+0000", 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-06 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997681+0000", 2024-09-16T04:09:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3952e-05 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:21.997701+0000", 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0378999999999999e-05 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007640+0000", 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099382580000000002 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.007780+0000", 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140369 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010437+0000", 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002657459 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.010564+0000", 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012679299999999999 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:22.012966+0000", 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024021590000000001 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:439 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1769472,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.796656152000001, 2024-09-16T04:09:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095037699999999999, 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 439 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071030+0000", 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071031+0000", 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8999999999999997e-07 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071035+0000", 2024-09-16T04:09:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.476e-06 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071042+0000", 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8569999999999997e-06 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071050+0000", 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4410000000000004e-06 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071119+0000", 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9746999999999995e-05 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.071122+0000", 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.869e-06 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073841+0000", 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027184179999999998 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.073967+0000", 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012589400000000001 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:38.080534+0000", 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065675780000000001 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:658 3.0s0 3:0316444d:::smithi20431790-46:head [create,setxattr Z]ca\\SkkXhsYi]s_mecUZQfPbbjaqacZrSObr_`a (734) in=40b,setxattr i (1998) in=1b,setxattr OQosgYUVOPebZdfit`Xtcc]XX_pdNqdkSof_lrck (1822) in=40b,setxattr mrQaYTllqfj^q]UYaoR`drdgY]bVfYQ\\SgOe_gca (1789) in=40b,setxattr ZaeONfchPlXaOYt[dQNtaR[NNiaSangpfQNVhVY[ (1646) in=40b,setxattr epskr[spqr^j^XqcosqPQ (1998) in=21b,setxattr WarqdipUlkSQhTbQR[NhrYRrda[QmOgj^VqWWero (313) in=40b,setxattr f\\fnrpSa`gWXj`Yo`dQY]Vdr[Z^`gkVjb^enmUig (1645) in=40b,setxattr bjWaN_RafX`the (1998) in=14b,setxattr nmdNljVWb`aR_`Oeb[l_OntR_YgidWjRabRf[]Ye (10596) in=40b,setxattr [nhisfmkVd_n_YV\\efebsW_pQaiWle_]o]rhc[bO (14456) in=40b,setxattr []hmkY]V]hkrrd]gr\\c\\hPq_smnTfakPZRNg^bY[ (1649) in=40b,setxattr ZZ\\\\jZnU`jtY\\[k]hnm`r_OYQeWTg\\rnQdX^rbhg (807) in=40b,setxattr QT_d^gX[dNZPP\\VapoetR^[gpVcZQXfhp^`l_Vh[ (66) in=40b,setxattr ee[ (1998) in=3b,setxattr RY\\sp]UifT[Zt\\[VenNWarqiiNSXsdnktf^QhT[U (487) in=40b,setxattr hUnl\\fnak]U``QN^rs`a^kfaQ`NoTVNnPXYbdmre (13680) in=40b,setxattr gha[S`afeloOcnfbeOkUV]T]ZTYWaOeaS]bbVa\\Q (1226) in=40b,setxattr NaraXbinjWQraPh`Pp]qnPWgWfZf[WaUb]oOY]^r (1611) in=40b,setxattr tpfZiddi]a^RVWpgOZormUeqYosdY_UsSpiQQRgj (1225) in=40b] snapc 14=[14,13] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-16T04:09:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.976606127, 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089480040000000007, 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 658 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891081+0000", 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891085+0000", 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6970000000000001e-06 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891315+0000", 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022967199999999999 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891341+0000", 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5673999999999998e-05 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891351+0000", 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0013000000000001e-05 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891476+0000", 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012553900000000001 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.891490+0000", 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4047e-05 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.893817+0000", 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023270819999999998 2024-09-16T04:09:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.893904+0000", 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6553999999999998e-05 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.894635+0000", 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073132899999999996 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.895889+0000", 2024-09-16T04:09:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012542040000000001 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.899945+0000", 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040559890000000003 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:08:52.900029+0000", 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3203999999999998e-05 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:831 3.0s0 3:0daec8ce:::smithi20431790-33:head [append 0~0] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.891095+0000", 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9765915950000004, 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024675063000000001, 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 831 2024-09-16T04:09:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891095+0000", 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891095+0000", 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891099+0000", 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.546e-06 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891113+0000", 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3974e-05 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891149+0000", 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6264999999999999e-05 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891169+0000", 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0543999999999998e-05 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891470+0000", 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030041600000000002 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891493+0000", 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3136999999999999e-05 2024-09-16T04:09:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.895949+0000", 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044561840000000002 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896278+0000", 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032894700000000001 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.902719+0000", 2024-09-16T04:09:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064409330000000002 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915610+0000", 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012890929000000001 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915675+0000", 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5221000000000005e-05 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915770+0000", 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4967000000000001e-05 2024-09-16T04:09:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:832 3.0s0 3:0daec8ce:::smithi20431790-33:head [rollback 18] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.891229+0000", 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9764578909999999, 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.030106270000000001, 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891229+0000", 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891229+0000", 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891230+0000", 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.356e-06 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891238+0000", 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0269999999999995e-06 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891260+0000", 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1985999999999999e-05 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891275+0000", 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5322999999999999e-05 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891831+0000", 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055522500000000001 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891848+0000", 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7723e-05 2024-09-16T04:09:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.908035+0000", 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016186645 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.908302+0000", 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026731500000000001 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.910437+0000", 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021349810000000002 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.915773+0000", 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053359319999999998 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.921131+0000", 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053574369999999996 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.921335+0000", 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020432 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:833 3.0s0 3:0daec8ce:::smithi20431790-33:head [append 0~0] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.891300+0000", 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9763867790000003, 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033121494000000001, 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 833 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891300+0000", 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891300+0000", 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891301+0000", 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2300000000000001e-06 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891307+0000", 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7660000000000004e-06 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891323+0000", 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6019999999999999e-05 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891336+0000", 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2676e-05 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891915+0000", 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057959400000000001 2024-09-16T04:09:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.891923+0000", 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7959999999999996e-06 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.911112+0000", 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019188983 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.911232+0000", 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012009400000000001 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.911781+0000", 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054867999999999996 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.916708+0000", 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276390000000002 2024-09-16T04:09:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.924299+0000", 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007590411 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.924421+0000", 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122605 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.2s1 79/31 ECSubWrite(tid=343, reqid=osd.11.0:343, at_version=79'108, trim_to=0'0, roll_forward_to=78'106))", 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.893554+0000", 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9741323560000001, 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094833000000000001, 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893554+0000", 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893554+0000", 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893555+0000", 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0999999999999997e-07 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893616+0000", 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0668999999999998e-05 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893646+0000", 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0722000000000002e-05 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893670+0000", 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3357e-05 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893903+0000", 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000232745 2024-09-16T04:09:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.893932+0000", 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9315999999999998e-05 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.902959+0000", 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0090269960000000007 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.903038+0000", 2024-09-16T04:09:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8684999999999996e-05 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.cs3 79/31 ECSubWrite(tid=164, reqid=osd.5.0:164, at_version=79'73, trim_to=0'0, roll_forward_to=77'71))", 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.896204+0000", 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9714829510000005, 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091319290000000004, 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896204+0000", 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896204+0000", 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896204+0000", 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0299999999999999e-07 2024-09-16T04:09:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896261+0000", 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6685999999999999e-05 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896291+0000", 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0355999999999999e-05 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896324+0000", 2024-09-16T04:09:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2579000000000001e-05 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896732+0000", 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040774799999999999 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896756+0000", 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3966999999999999e-05 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905294+0000", 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085378959999999997 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.905336+0000", 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2094000000000001e-05 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(3.2s1 79/31 ECSubWrite(tid=344, reqid=osd.11.0:344, at_version=79'110, trim_to=0'0, roll_forward_to=78'106))", 2024-09-16T04:09:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:01.896835+0000", 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.970851229, 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01134959, 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896835+0000", 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896835+0000", 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896837+0000", 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2500000000000001e-06 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896883+0000", 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6249999999999999e-05 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896906+0000", 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2844e-05 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.896919+0000", 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.361e-05 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897071+0000", 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152029 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.897099+0000", 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8017e-05 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.908085+0000", 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010985798 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:01.908185+0000", 2024-09-16T04:09:09.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9791999999999996e-05 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:934 3.0s0 3:0316444d:::smithi20431790-46:head [append 0~81920] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.666811+0000", 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.2008757020000003, 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013477631, 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.966 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.666811+0000", 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.666811+0000", 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.666814+0000", 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.79e-06 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667092+0000", 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000278394 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667128+0000", 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-16T04:09:09.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667148+0000", 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0692000000000001e-05 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667355+0000", 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020635299999999999 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667821+0000", 2024-09-16T04:09:09.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046654699999999999 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.670280+0000", 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024587189999999998 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.674973+0000", 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046931910000000002 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.680153+0000", 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051798809999999999 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.680289+0000", 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013545399999999999 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:935 3.0s0 3:0316444d:::smithi20431790-46:head [setxattr _header (57) in=7b] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.667216+0000", 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.2004706370000005, 2024-09-16T04:09:09.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014369440000000001, 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 935 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667216+0000", 2024-09-16T04:09:09.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667216+0000", 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667218+0000", 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6899999999999999e-06 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667229+0000", 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.094e-05 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667255+0000", 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6156000000000002e-05 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667269+0000", 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4192999999999999e-05 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.672474+0000", 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052050480000000003 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.672774+0000", 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030044400000000003 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.673959+0000", 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011849600000000001 2024-09-16T04:09:09.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.675851+0000", 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001892059 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.681349+0000", 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054978249999999996 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.681585+0000", 2024-09-16T04:09:09.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023612500000000001 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4631.0:936 3.0s0 3:0316444d:::smithi20431790-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-16T04:09:02.667376+0000", 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.2003111100000003, 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018403314, 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-16T04:09:09.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4631", 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 936 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667376+0000", 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667376+0000", 2024-09-16T04:09:09.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667377+0000", 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667388+0000", 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0827e-05 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667428+0000", 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9725000000000003e-05 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.667448+0000", 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0503e-05 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.674674+0000", 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072260780000000004 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.674934+0000", 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025986100000000001 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.682543+0000", 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076082739999999999 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.682784+0000", 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024138499999999999 2024-09-16T04:09:09.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-16T04:09:02.685779+0000", 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002994881 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-16T04:09:09.982 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:09.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T04:09:09.984 INFO:teuthology.orchestra.run.smithi032.stderr:marked in osd.8. 2024-09-16T04:09:09.985 INFO:tasks.thrashosds.thrasher:Added osd 8 2024-09-16T04:09:09.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-16T04:09:10.121 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:10.122 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:10.122 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:10.122 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:10.127 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-09-16T04:09:10.127 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T04:09:10.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-16T04:09:10.138 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-09-16T04:09:10.138 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T04:09:10.153 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-09-16T04:09:10.154 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T04:09:10.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T04:09:10.260 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:10.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:10.260 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:10.260 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:10.260 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:10.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-16T04:09:10.405 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.465048070999998, 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0080395369999999994, 2024-09-16T04:09:10.406 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936929+0000", 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.936932+0000", 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0530000000000001e-06 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937019+0000", 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7212000000000005e-05 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937052+0000", 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3331000000000003e-05 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937092+0000", 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9437000000000002e-05 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937324+0000", 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023248400000000001 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.937349+0000", 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5398e-05 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944874+0000", 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0075243269999999999 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944969+0000", 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5295000000000002e-05 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.410 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=160, reqid=client.4631.0:25, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.460076231000002, 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063272570000000002, 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941901+0000", 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941903+0000", 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.457e-06 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942075+0000", 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017237900000000001 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942114+0000", 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8433000000000003e-05 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942137+0000", 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3442e-05 2024-09-16T04:09:10.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944009+0000", 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018714789999999999 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944031+0000", 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2912e-05 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948133+0000", 2024-09-16T04:09:10.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041011930000000004 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948229+0000", 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5962e-05 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 33/31 ECSubWrite(tid=161, reqid=client.4631.0:26, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:09:10.415 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.459630707999999, 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059926320000000003, 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942347+0000", 2024-09-16T04:09:10.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942348+0000", 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2300000000000001e-06 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942388+0000", 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0377000000000003e-05 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942419+0000", 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0957000000000002e-05 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942449+0000", 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9578e-05 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945390+0000", 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029405360000000001 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.945413+0000", 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3901999999999999e-05 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948238+0000", 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028249 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.948339+0000", 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101152 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.419 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:58, at_version=34'3, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.425903443999999, 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064471959999999997, 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976074+0000", 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976076+0000", 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9429999999999999e-06 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976477+0000", 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000400567 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976509+0000", 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2762999999999998e-05 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976533+0000", 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3167999999999999e-05 2024-09-16T04:09:10.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976778+0000", 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245324 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976803+0000", 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4780999999999999e-05 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982391+0000", 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055884929999999999 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982521+0000", 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013015699999999999 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=11, reqid=client.4631.0:59, at_version=34'4, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:10.424 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.422380044999997, 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072774700000000003, 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979598+0000", 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979599+0000", 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8530000000000001e-06 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979644+0000", 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4736e-05 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979677+0000", 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2681000000000001e-05 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979701+0000", 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3754999999999999e-05 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979867+0000", 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166689 2024-09-16T04:09:10.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979890+0000", 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3264e-05 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986795+0000", 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069048069999999998 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986875+0000", 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9684999999999993e-05 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 34/31 ECSubWrite(tid=12, reqid=client.4631.0:64, at_version=34'5, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.418787662, 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076880730000000001, 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.429 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983190+0000", 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983192+0000", 2024-09-16T04:09:10.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983586+0000", 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039456700000000002 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983617+0000", 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0574000000000002e-05 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983639+0000", 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2178999999999999e-05 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983866+0000", 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227366 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983888+0000", 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1804e-05 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990760+0000", 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068715030000000002 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990878+0000", 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011824600000000001 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 34/31 ECSubWrite(tid=16, reqid=client.4631.0:56, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:10.433 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.417033951000001, 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064676780000000001, 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984944+0000", 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984946+0000", 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1289999999999999e-06 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984990+0000", 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3776000000000002e-05 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985022+0000", 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2345999999999998e-05 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985043+0000", 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1549999999999999e-05 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985376+0000", 2024-09-16T04:09:10.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033260599999999999 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985400+0000", 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4015e-05 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991311+0000", 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059112239999999996 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991411+0000", 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010003199999999999 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds1 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.415351340999997, 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059755490000000001, 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.438 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986626+0000", 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986628+0000", 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.905e-06 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986905+0000", 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027719099999999998 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986953+0000", 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8182e-05 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986976+0000", 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2997999999999999e-05 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987170+0000", 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000193217 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987190+0000", 2024-09-16T04:09:10.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0588999999999999e-05 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992498+0000", 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053074669999999997 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992602+0000", 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010399999999999999 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 44.367712930000003, 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062924130000000002, 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:09:10.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034265+0000", 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034266+0000", 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0669999999999999e-06 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034464+0000", 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000198808 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034506+0000", 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.197e-05 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034540+0000", 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3098000000000001e-05 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034723+0000", 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018367500000000001 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.034753+0000", 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9292e-05 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040460+0000", 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057071020000000004 2024-09-16T04:09:10.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:26.040557+0000", 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7400999999999998e-05 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=210, reqid=client.4631.0:296, at_version=44'28, trim_to=0'0, roll_forward_to=43'26))", 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.371114753000001, 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061099889999999997, 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030863+0000", 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030927+0000", 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3188999999999994e-05 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030971+0000", 2024-09-16T04:09:10.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4634e-05 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.030995+0000", 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4032e-05 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031211+0000", 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021563299999999999 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.031241+0000", 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0329e-05 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036878+0000", 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056365449999999997 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.036973+0000", 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5047e-05 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 44/31 ECSubWrite(tid=216, reqid=client.4631.0:301, at_version=0'0, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.34619592, 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059219310000000001, 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055782+0000", 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055784+0000", 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9929999999999998e-06 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055815+0000", 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055858+0000", 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3096999999999998e-05 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.055879+0000", 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1688999999999999e-05 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056067+0000", 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018760099999999999 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.056101+0000", 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3775000000000001e-05 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061623+0000", 2024-09-16T04:09:10.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055219730000000003 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061704+0000", 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0897999999999997e-05 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 48/31 ECSubWrite(tid=223, reqid=osd.11.0:223, at_version=48'36, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:09:10.456 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.548953247, 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058830389999999996, 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853024+0000", 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853026+0000", 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0899999999999999e-06 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853087+0000", 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0560000000000003e-05 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853119+0000", 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2104999999999998e-05 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853144+0000", 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4912000000000001e-05 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855175+0000", 2024-09-16T04:09:10.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002031007 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855211+0000", 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5680999999999999e-05 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858817+0000", 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036060860000000001 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.858907+0000", 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0598000000000002e-05 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.548774473000002, 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098485320000000001, 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853203+0000", 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853204+0000", 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0300000000000001e-06 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853263+0000", 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9006999999999999e-05 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853290+0000", 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6520999999999999e-05 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853309+0000", 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9826e-05 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857423+0000", 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041136109999999997 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:10.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1618000000000001e-05 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862892+0000", 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005437491 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863052+0000", 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015942800000000001 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.548488226000003, 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069765720000000003, 2024-09-16T04:09:10.466 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853489+0000", 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853490+0000", 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3699999999999999e-07 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853601+0000", 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111047 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853629+0000", 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7568000000000001e-05 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853648+0000", 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9199e-05 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857263+0000", 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036145560000000001 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857285+0000", 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2382e-05 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860374+0000", 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030894009999999999 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.860466+0000", 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1582000000000005e-05 2024-09-16T04:09:10.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.546142973000002, 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072392969999999996, 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855835+0000", 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855836+0000", 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3699999999999999e-07 2024-09-16T04:09:10.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855889+0000", 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.346e-05 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855913+0000", 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3635e-05 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.855930+0000", 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7499e-05 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857410+0000", 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001480121 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.857433+0000", 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2582000000000002e-05 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.862976+0000", 2024-09-16T04:09:10.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055433549999999998 2024-09-16T04:09:10.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.863074+0000", 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7707999999999994e-05 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.8s5 54/31 ECSubWrite(tid=254, reqid=osd.11.0:254, at_version=54'19, trim_to=0'0, roll_forward_to=52'17))", 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.33361292, 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078273349999999995, 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068365+0000", 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6000000000000003e-07 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068423+0000", 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7707000000000002e-05 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068454+0000", 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0882e-05 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068478+0000", 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4362000000000002e-05 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068698+0000", 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021970299999999999 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068725+0000", 2024-09-16T04:09:10.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7279000000000001e-05 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076089+0000", 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0073640800000000003 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076192+0000", 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102662 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.2s3 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.333408036999998, 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076635829999999999, 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068570+0000", 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068571+0000", 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1599999999999999e-06 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068645+0000", 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4610999999999994e-05 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068672+0000", 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6710999999999999e-05 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068692+0000", 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0373e-05 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068869+0000", 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017663499999999999 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.068896+0000", 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7231999999999999e-05 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076166+0000", 2024-09-16T04:09:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007269948 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.076233+0000", 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6913000000000001e-05 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.bs5 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.330685146999997, 2024-09-16T04:09:10.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074803539999999998, 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071292+0000", 2024-09-16T04:09:10.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071293+0000", 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1699999999999998e-07 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071345+0000", 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1811000000000003e-05 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071377+0000", 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2061999999999999e-05 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071404+0000", 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7072000000000001e-05 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071568+0000", 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163609 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.071626+0000", 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8811000000000003e-05 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078616+0000", 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069891459999999999 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:37.078773+0000", 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157226 2024-09-16T04:09:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 75/31 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=75'61, trim_to=0'0, roll_forward_to=74'59))", 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.868731+0000", 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.533246282, 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065364189999999999, 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868731+0000", 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868731+0000", 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868732+0000", 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-16T04:09:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868786+0000", 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4314999999999998e-05 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868820+0000", 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3532999999999999e-05 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.868847+0000", 2024-09-16T04:09:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7509e-05 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869014+0000", 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016654500000000001 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869044+0000", 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9916e-05 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875193+0000", 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061493889999999999 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875268+0000", 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4407999999999996e-05 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as1 79/31 ECSubWrite(tid=210, reqid=osd.13.0:208, at_version=0'0, trim_to=0'0, roll_forward_to=79'71))", 2024-09-16T04:09:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:01.901739+0000", 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.5002390020000007, 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064141609999999998, 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901739+0000", 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901739+0000", 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901740+0000", 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9369999999999998e-06 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901768+0000", 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7416e-05 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901801+0000", 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.269e-05 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.901823+0000", 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1909e-05 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.906488+0000", 2024-09-16T04:09:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046659809999999996 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.906513+0000", 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4814999999999999e-05 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.908119+0000", 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016054789999999999 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:01.908153+0000", 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3933999999999997e-05 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.499 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:10.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-16T04:09:10.632 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:10.632 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:10.632 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:10.632 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:10.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-16T04:09:10.773 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:10.773 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:10.774 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:10.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-16T04:09:10.918 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:10.918 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:34 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~196608,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.964634185000001, 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023419893000000001, 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 34 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949747+0000", 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949751+0000", 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3790000000000002e-06 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951559+0000", 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018085589999999999 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951588+0000", 2024-09-16T04:09:10.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8728e-05 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951607+0000", 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8817999999999998e-05 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951866+0000", 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025890800000000002 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952244+0000", 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378222 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.954553+0000", 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023090099999999998 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961470+0000", 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069174079999999999 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972971+0000", 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011500923999999999 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973167+0000", 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195937 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.925 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:35 3.cs0 3:3ee250f2:::smithi20431790-12:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:10.925 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:09:10.925 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.962723855, 2024-09-16T04:09:10.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.029134334000000001, 2024-09-16T04:09:10.925 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 35 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951658+0000", 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951660+0000", 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.176e-06 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951673+0000", 2024-09-16T04:09:10.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2799000000000001e-05 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951697+0000", 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4698e-05 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951715+0000", 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7265000000000002e-05 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957234+0000", 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055191260000000001 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.957565+0000", 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033102199999999999 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960023+0000", 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002458567 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.963486+0000", 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034622020000000002 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980404+0000", 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016918914 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980792+0000", 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038756499999999998 2024-09-16T04:09:10.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:36 3.cs0 3:3ee250f2:::smithi20431790-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.962641288999997, 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.045222315999999999, 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.931 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 36 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951740+0000", 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951742+0000", 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.513e-06 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951749+0000", 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7190000000000001e-06 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951770+0000", 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0092e-05 2024-09-16T04:09:10.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.951785+0000", 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5162e-05 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961177+0000", 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093920979999999998 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.961445+0000", 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000268664 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981947+0000", 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020501287999999999 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982122+0000", 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017487899999999999 2024-09-16T04:09:10.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996963+0000", 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014840901 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:49 3.5s0 3:a07911e0:::smithi20431790-17:head [append 0~278528,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.949967293, 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017107101999999999, 2024-09-16T04:09:10.936 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 49 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964414+0000", 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964417+0000", 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0529999999999998e-06 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964962+0000", 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054521099999999998 2024-09-16T04:09:10.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.964997+0000", 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4028e-05 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965020+0000", 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3553999999999998e-05 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965225+0000", 2024-09-16T04:09:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020534700000000001 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965562+0000", 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000336332 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967943+0000", 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023810950000000002 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971887+0000", 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039443120000000002 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981336+0000", 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0094491490000000004 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981521+0000", 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000185021 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:50 3.5s0 3:a07911e0:::smithi20431790-17:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.9492805, 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018470364999999999, 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 50 2024-09-16T04:09:10.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965101+0000", 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965103+0000", 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965114+0000", 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1616e-05 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965139+0000", 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4711000000000001e-05 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965158+0000", 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8774999999999999e-05 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969089+0000", 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039314490000000001 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.969306+0000", 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021679300000000001 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.970337+0000", 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001030385 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974758+0000", 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044213810000000003 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983346+0000", 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085879849999999994 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983571+0000", 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225427 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.947 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:51 3.5s0 3:a07911e0:::smithi20431790-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.949186935, 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022912589000000001, 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 51 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965195+0000", 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965196+0000", 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5e-06 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965204+0000", 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965227+0000", 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2751e-05 2024-09-16T04:09:10.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.965247+0000", 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0404999999999999e-05 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971064+0000", 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058171619999999999 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.971306+0000", 2024-09-16T04:09:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024202800000000001 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984390+0000", 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013083734 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984580+0000", 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000190101 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988107+0000", 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035270050000000002 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:70 3.cs0 3:32f692e4:::smithi20431790-24:head [append 0~393216,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.929912201999997, 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022625648000000002, 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 70 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984469+0000", 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984472+0000", 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5770000000000001e-06 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985137+0000", 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00066504699999999999 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985170+0000", 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2877999999999999e-05 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985193+0000", 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3014999999999999e-05 2024-09-16T04:09:10.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.988812+0000", 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003619583 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.989134+0000", 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000321496 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.992649+0000", 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003514994 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997670+0000", 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050209540000000002 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006922+0000", 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092525839999999995 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007095+0000", 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017252000000000001 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:71 3.cs0 3:32f692e4:::smithi20431790-24:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.929151648000001, 2024-09-16T04:09:10.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024343912999999998, 2024-09-16T04:09:10.960 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.960 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.961 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 71 2024-09-16T04:09:10.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.961 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985230+0000", 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985232+0000", 2024-09-16T04:09:10.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7710000000000001e-06 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985241+0000", 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985269+0000", 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7426000000000001e-05 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985286+0000", 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994404+0000", 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.009118279 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994605+0000", 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020087800000000001 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995926+0000", 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013212320000000001 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998575+0000", 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026493300000000001 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009408+0000", 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010832965999999999 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.009574+0000", 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165487 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:72 3.cs0 3:32f692e4:::smithi20431790-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.929071506, 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.030489715000000001, 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 72 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985310+0000", 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985311+0000", 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.234e-06 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985319+0000", 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8110000000000003e-06 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985338+0000", 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9372e-05 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985354+0000", 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997327+0000", 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011973477999999999 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997539+0000", 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021212 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010366+0000", 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012826743 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.010517+0000", 2024-09-16T04:09:10.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150987 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015800+0000", 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052827170000000001 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:79 3.5s0 3:a92fec0c:::smithi20431790-27:head [append 0~442368,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:09:10.971 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.921163817999997, 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022443769999999998, 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 79 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993218+0000", 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993221+0000", 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1939999999999998e-06 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994063+0000", 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000842401 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994096+0000", 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2977e-05 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994117+0000", 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0632000000000002e-05 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994356+0000", 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023911000000000001 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994668+0000", 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031195700000000002 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.998787+0000", 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041189850000000004 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004001+0000", 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052138510000000002 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015531+0000", 2024-09-16T04:09:10.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011530004 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.015661+0000", 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013065900000000001 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:80 3.5s0 3:a92fec0c:::smithi20431790-27:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.920208995000003, 2024-09-16T04:09:10.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022213561999999999, 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 80 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994173+0000", 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994174+0000", 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6190000000000001e-06 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994185+0000", 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1014e-05 2024-09-16T04:09:10.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994208+0000", 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2677999999999999e-05 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994225+0000", 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7238e-05 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001985+0000", 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077595709999999998 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002157+0000", 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017256300000000001 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003005+0000", 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00084732500000000001 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004682+0000", 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016769899999999999 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016279+0000", 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011597303 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016386+0000", 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107261 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:81 3.5s0 3:a92fec0c:::smithi20431790-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.919893807999998, 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025428882, 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 81 2024-09-16T04:09:10.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994488+0000", 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994490+0000", 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.843e-06 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994499+0000", 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6420000000000002e-06 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994529+0000", 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9405999999999999e-05 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994548+0000", 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9884000000000001e-05 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004211+0000", 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0096627850000000001 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.004368+0000", 2024-09-16T04:09:10.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015635099999999999 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.016915+0000", 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012547063000000001 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.017089+0000", 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017398399999999999 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.019917+0000", 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028279239999999999 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:302 3.cs0 3:374a82ae:::smithi20431790-44:head [append 0~475136] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.880308018999997, 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018500445000000001, 2024-09-16T04:09:10.988 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 302 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034073+0000", 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.034077+0000", 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2820000000000001e-06 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038863+0000", 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047866250000000001 2024-09-16T04:09:10.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038897+0000", 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3225000000000001e-05 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.038915+0000", 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8802000000000001e-05 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.039123+0000", 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000207641 2024-09-16T04:09:10.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.039359+0000", 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023585199999999999 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.041836+0000", 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024766670000000001 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.046352+0000", 2024-09-16T04:09:10.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0045161610000000003 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052364+0000", 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060125530000000003 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.052574+0000", 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020963700000000001 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:306 3.cs0 3:374a82ae:::smithi20431790-44:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866945934, 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.026506662, 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 306 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.994 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047436+0000", 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047437+0000", 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2500000000000001e-06 2024-09-16T04:09:10.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047443+0000", 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.426e-06 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047463+0000", 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0193000000000001e-05 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.047473+0000", 2024-09-16T04:09:10.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3689999999999996e-06 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063090+0000", 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015617617 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.063269+0000", 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017882900000000001 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:10.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064581+0000", 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001311986 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064808+0000", 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022633899999999999 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.073942+0000", 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0091346529999999995 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:10.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:469 3.cs0 3:3ee250f2:::smithi20431790-12:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.061502976, 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016802089999999999, 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 469 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:10.999 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852879+0000", 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852880+0000", 2024-09-16T04:09:11.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852891+0000", 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1263e-05 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852917+0000", 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5423e-05 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852934+0000", 2024-09-16T04:09:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7062e-05 2024-09-16T04:09:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859376+0000", 2024-09-16T04:09:11.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064419810000000003 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859639+0000", 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026322599999999998 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861937+0000", 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022980449999999999 2024-09-16T04:09:11.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864439+0000", 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025016249999999999 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869468+0000", 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050291470000000003 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869681+0000", 2024-09-16T04:09:11.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021285799999999999 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:509 3.cs0 3:3ee250f2:::smithi20431790-12:head [copy-from ver 8] snapc 10=[f] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:46.159683+0000", 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.754698703999999, 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.025618154000000001, 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 509 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159683+0000", 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159683+0000", 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159685+0000", 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6809999999999998e-06 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159700+0000", 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4446e-05 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159724+0000", 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3764000000000002e-05 2024-09-16T04:09:11.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159737+0000", 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3078000000000001e-05 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159929+0000", 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019179900000000001 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.160106+0000", 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017779699999999999 2024-09-16T04:09:11.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.176614+0000", 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016508088000000001 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179793+0000", 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00317827 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.185125+0000", 2024-09-16T04:09:11.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053325910000000002 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.185301+0000", 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017563999999999999 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:510 3.cs0 3:3ee250f2:::smithi20431790-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:46.159763+0000", 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.754618115, 2024-09-16T04:09:11.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020020685, 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 510 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159763+0000", 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159763+0000", 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159764+0000", 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5199999999999996e-07 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159776+0000", 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2218999999999999e-05 2024-09-16T04:09:11.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159787+0000", 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0463e-05 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.159795+0000", 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4929999999999998e-06 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.160405+0000", 2024-09-16T04:09:11.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000609375 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.160485+0000", 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9930000000000002e-05 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179211+0000", 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.018726652999999999 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179476+0000", 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026453400000000003 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.179784+0000", 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030836600000000002 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:765 3.cs0 3:3ee250f2:::smithi20431790-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.270867+0000", 2024-09-16T04:09:11.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.643514721000001, 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017981079000000001, 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 765 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270867+0000", 2024-09-16T04:09:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270867+0000", 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270868+0000", 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5000000000000001e-07 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270873+0000", 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2499999999999997e-06 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270902+0000", 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9209000000000001e-05 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.270923+0000", 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0469e-05 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.282951+0000", 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012028143999999999 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.283184+0000", 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233637 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.285737+0000", 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025525959999999999 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.285975+0000", 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000237913 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.288848+0000", 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028729110000000001 2024-09-16T04:09:11.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:944 3.5s0 3:a92fec0c:::smithi20431790-27:head [setxattr _header (57) in=7b] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.670182+0000", 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2441992150000001, 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019828129, 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 944 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670182+0000", 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670182+0000", 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670183+0000", 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.64e-07 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670199+0000", 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5823000000000001e-05 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670221+0000", 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2087e-05 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670231+0000", 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0237e-05 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.674015+0000", 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037832159999999998 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.674125+0000", 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110661 2024-09-16T04:09:11.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.674666+0000", 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054037200000000001 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.675673+0000", 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010077930000000001 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.689888+0000", 2024-09-16T04:09:11.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014214485000000001 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.690010+0000", 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012249099999999999 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:945 3.5s0 3:a92fec0c:::smithi20431790-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.670292+0000", 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2440894139999994, 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023379965999999999, 2024-09-16T04:09:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 945 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670292+0000", 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670292+0000", 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670293+0000", 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8700000000000005e-07 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670296+0000", 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6720000000000002e-06 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670309+0000", 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2235000000000001e-05 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.670316+0000", 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6690000000000006e-06 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.675406+0000", 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050893220000000003 2024-09-16T04:09:11.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.675642+0000", 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023648300000000001 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.690685+0000", 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015042971 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.690799+0000", 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114239 2024-09-16T04:09:11.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.693672+0000", 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002872688 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.031 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:11.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-16T04:09:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T04:09:11.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-16T04:09:11.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-16T04:09:11.165 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:11.165 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:11.165 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:11.165 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:11.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-16T04:09:11.307 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:11.307 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:11.307 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:11.307 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:11.307 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:11.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.514067439999998, 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063652539999999999, 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938468+0000", 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938469+0000", 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2699999999999998e-07 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938635+0000", 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016581300000000001 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938684+0000", 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9576000000000001e-05 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938883+0000", 2024-09-16T04:09:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000199173 2024-09-16T04:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939095+0000", 2024-09-16T04:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000211246 2024-09-16T04:09:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939119+0000", 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4357000000000001e-05 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944738+0000", 2024-09-16T04:09:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056193900000000001 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944833+0000", 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4871999999999996e-05 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=2, reqid=client.4631.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.513528117999996, 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047666380000000001, 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939007+0000", 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939008+0000", 2024-09-16T04:09:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.13e-07 2024-09-16T04:09:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939093+0000", 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5012999999999994e-05 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939129+0000", 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5636999999999998e-05 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939152+0000", 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3745000000000001e-05 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939447+0000", 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029490799999999998 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939469+0000", 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1848000000000002e-05 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943713+0000", 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042438789999999999 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943774+0000", 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0995000000000001e-05 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.513448134999997, 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0058140029999999999, 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939087+0000", 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939089+0000", 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5570000000000001e-06 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939159+0000", 2024-09-16T04:09:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0069999999999998e-05 2024-09-16T04:09:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939189+0000", 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9971000000000002e-05 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.939212+0000", 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3088999999999999e-05 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941350+0000", 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021383169999999998 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941374+0000", 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3742000000000001e-05 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944842+0000", 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034683349999999999 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944901+0000", 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8922000000000003e-05 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 33/31 ECSubWrite(tid=3, reqid=client.4631.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.510387997999999, 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050280460000000004, 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942147+0000", 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942149+0000", 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.694e-06 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942191+0000", 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1461999999999997e-05 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942224+0000", 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3181e-05 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942254+0000", 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0151e-05 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942467+0000", 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000212862 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.942490+0000", 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3227999999999999e-05 2024-09-16T04:09:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947072+0000", 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00458203 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.947176+0000", 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010343799999999999 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=8, reqid=client.4631.0:61, at_version=34'5, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.475073193, 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0063833630000000004, 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977462+0000", 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977464+0000", 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.531e-06 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977708+0000", 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024464000000000002 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977740+0000", 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1711000000000002e-05 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977762+0000", 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1399e-05 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977934+0000", 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000172654 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977956+0000", 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1435000000000001e-05 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983751+0000", 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057949120000000002 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983846+0000", 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5081000000000007e-05 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=9, reqid=client.4631.0:62, at_version=34'6, trim_to=0'0, roll_forward_to=34'4))", 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.474283081999999, 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056761249999999997, 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978252+0000", 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978254+0000", 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.488e-06 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978292+0000", 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7880000000000003e-05 2024-09-16T04:09:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978321+0000", 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9023e-05 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978340+0000", 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9524000000000001e-05 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979207+0000", 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00086708800000000002 2024-09-16T04:09:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979243+0000", 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5457000000000003e-05 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983860+0000", 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046170930000000001 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983929+0000", 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8571999999999993e-05 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 34/31 ECSubWrite(tid=6, reqid=client.4631.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.468507279999997, 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011901461, 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984028+0000", 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984031+0000", 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3429999999999998e-06 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984058+0000", 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7029000000000002e-05 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984089+0000", 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1016999999999998e-05 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984109+0000", 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0842000000000001e-05 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984406+0000", 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029609200000000002 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.984434+0000", 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8918e-05 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995793+0000", 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011358052 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995930+0000", 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013716800000000001 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.466117027999999, 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0095992419999999992, 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986418+0000", 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.986420+0000", 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.934e-06 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987321+0000", 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00090024099999999998 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987354+0000", 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3154999999999997e-05 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987376+0000", 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1923999999999999e-05 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987514+0000", 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013814799999999999 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.987534+0000", 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9873000000000001e-05 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995938+0000", 2024-09-16T04:09:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084043529999999998 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996018+0000", 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9614e-05 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.3s1 34/31 ECSubWrite(tid=10, reqid=client.4631.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:09:11.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.462489558000001, 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059765189999999996, 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990046+0000", 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990048+0000", 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8509999999999999e-06 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990075+0000", 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7158e-05 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990106+0000", 2024-09-16T04:09:11.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1080000000000001e-05 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990136+0000", 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9901000000000001e-05 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990290+0000", 2024-09-16T04:09:11.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015433800000000001 2024-09-16T04:09:11.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990314+0000", 2024-09-16T04:09:11.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3421000000000002e-05 2024-09-16T04:09:11.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995910+0000", 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0055967500000000002 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996022+0000", 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011202 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 38/31 ECSubWrite(tid=32, reqid=client.4631.0:186, at_version=38'8, trim_to=0'0, roll_forward_to=34'6))", 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.478607857999997, 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048151569999999996, 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973928+0000", 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6599999999999996e-07 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.973995+0000", 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6209000000000003e-05 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974069+0000", 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4597000000000004e-05 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974094+0000", 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4532000000000002e-05 2024-09-16T04:09:11.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974684+0000", 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00058996600000000004 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.974697+0000", 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3689000000000001e-05 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.977292+0000", 2024-09-16T04:09:11.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025942180000000001 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:20.978743+0000", 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014512800000000001 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 40.598704945000001, 2024-09-16T04:09:11.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074691879999999999, 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853831+0000", 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853882+0000", 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0699999999999999e-05 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853914+0000", 2024-09-16T04:09:11.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1569000000000002e-05 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.853935+0000", 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1818e-05 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.854184+0000", 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024827300000000003 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.854210+0000", 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5885e-05 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.861170+0000", 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069599529999999996 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:30.861300+0000", 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013018599999999999 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.514 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.0s2 53/31 ECSubWrite(tid=66, reqid=client.4631.0:413, at_version=53'27, trim_to=0'0, roll_forward_to=52'25))", 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.382828173, 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053210929999999998, 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069707+0000", 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.069708+0000", 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0699999999999997e-07 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070037+0000", 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032869699999999997 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070073+0000", 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6288000000000002e-05 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070098+0000", 2024-09-16T04:09:11.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5075999999999998e-05 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070299+0000", 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020064 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.070326+0000", 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7291999999999999e-05 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.074948+0000", 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046217669999999997 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:36.075028+0000", 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0725999999999999e-05 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=104, reqid=client.4631.0:475, at_version=59'34, trim_to=0'0, roll_forward_to=52'32))", 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:09:11.519 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.591878487999999, 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056955520000000004, 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860657+0000", 2024-09-16T04:09:11.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860658+0000", 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860757+0000", 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9046e-05 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860802+0000", 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4814999999999997e-05 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860829+0000", 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7495e-05 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861131+0000", 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030179099999999998 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.861164+0000", 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3538999999999999e-05 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866258+0000", 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050931470000000001 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.866353+0000", 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5025999999999994e-05 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.523 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 64/31 ECSubWrite(tid=137, reqid=osd.13.0:137, at_version=64'17, trim_to=0'0, roll_forward_to=63'15))", 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:46.905385+0000", 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.547150186, 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050199229999999999, 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905385+0000", 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905385+0000", 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905386+0000", 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.39e-07 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905412+0000", 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6239999999999999e-05 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905437+0000", 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4569000000000001e-05 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905450+0000", 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.324e-05 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905655+0000", 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000204933 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.905670+0000", 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4859e-05 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.910346+0000", 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004676202 2024-09-16T04:09:11.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:46.910405+0000", 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9441000000000002e-05 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.ds4 73/31 ECSubWrite(tid=174, reqid=client.4631.0:740, at_version=73'20, trim_to=0'0, roll_forward_to=73'18))", 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:56.214251+0000", 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.238284394000001, 2024-09-16T04:09:11.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.007100164, 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.214251+0000", 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.214251+0000", 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.214254+0000", 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8739999999999999e-06 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218060+0000", 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038055710000000002 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218116+0000", 2024-09-16T04:09:11.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6331e-05 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218142+0000", 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5675999999999999e-05 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218315+0000", 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017352599999999999 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.218342+0000", 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7064999999999999e-05 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.221262+0000", 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00292026 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.221351+0000", 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8861000000000002e-05 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.532 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 74/31 ECSubWrite(tid=182, reqid=osd.13.0:182, at_version=74'59, trim_to=0'0, roll_forward_to=73'57))", 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.593338992, 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052387400000000004, 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859197+0000", 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4300000000000002e-07 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859264+0000", 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6354999999999997e-05 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859308+0000", 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4656000000000001e-05 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.859334+0000", 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5301999999999999e-05 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.861269+0000", 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019350179999999999 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.861295+0000", 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6228999999999999e-05 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.864335+0000", 2024-09-16T04:09:11.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030400399999999999 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:56.864435+0000", 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010039699999999999 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 75/31 ECSubWrite(tid=190, reqid=osd.13.0:190, at_version=75'61, trim_to=0'0, roll_forward_to=74'59))", 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.869673+0000", 2024-09-16T04:09:11.537 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.582862736999999, 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056653789999999999, 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869673+0000", 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869673+0000", 2024-09-16T04:09:11.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869674+0000", 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6300000000000004e-07 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869731+0000", 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7802e-05 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869766+0000", 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5065999999999999e-05 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869790+0000", 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3125999999999998e-05 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869971+0000", 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000181318 2024-09-16T04:09:11.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.869998+0000", 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7226e-05 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875246+0000", 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0052477340000000004 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.875338+0000", 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2343999999999995e-05 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.0s2 75/31 ECSubWrite(tid=107, reqid=osd.12.0:107, at_version=75'47, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.580348847, 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005798826, 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.542 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872187+0000", 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5400000000000001e-07 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872248+0000", 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0988e-05 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872296+0000", 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8278000000000001e-05 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872322+0000", 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5916999999999999e-05 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872497+0000", 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017428100000000001 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.872523+0000", 2024-09-16T04:09:11.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6789000000000001e-05 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.877867+0000", 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053438859999999999 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.877985+0000", 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118133 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.as5 75/31 ECSubWrite(tid=192, reqid=osd.13.0:190, at_version=0'0, trim_to=0'0, roll_forward_to=75'61))", 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.882182+0000", 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.570353176999999, 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050015349999999997, 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882182+0000", 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882182+0000", 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882185+0000", 2024-09-16T04:09:11.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.317e-06 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882214+0000", 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9819e-05 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882259+0000", 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4882000000000002e-05 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882283+0000", 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3223000000000001e-05 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882807+0000", 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052451600000000004 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.882834+0000", 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6704999999999999e-05 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.887084+0000", 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042498060000000001 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.887184+0000", 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010026699999999999 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDECSubOpWrite(3.5s3 76/31 ECSubWrite(tid=139, reqid=osd.5.0:139, at_version=76'24, trim_to=0'0, roll_forward_to=75'22))", 2024-09-16T04:09:11.551 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:58.894693+0000", 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.557842536000001, 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051752020000000003, 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894693+0000", 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894693+0000", 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894694+0000", 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894751+0000", 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7049000000000002e-05 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894784+0000", 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3815000000000001e-05 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894807+0000", 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2629999999999998e-05 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.894985+0000", 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017747499999999999 2024-09-16T04:09:11.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.895011+0000", 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6843e-05 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.899769+0000", 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00475772 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:58.899868+0000", 2024-09-16T04:09:11.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9077e-05 2024-09-16T04:09:11.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.556 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:11.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-16T04:09:11.690 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:11.690 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:11.690 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-16T04:09:11.690 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:11.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-16T04:09:11.833 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:11.833 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-16T04:09:11.833 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-16T04:09:11.833 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-16T04:09:11.833 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:11.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-16T04:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-16T04:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-16T04:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-16T04:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-16T04:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:9 3.as0 3:52d8912d:::smithi20431790-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 55.031422304000003, 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.032735913999999998, 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 9 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934091+0000", 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934092+0000", 2024-09-16T04:09:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3170000000000001e-06 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934099+0000", 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.37e-06 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934121+0000", 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2124999999999999e-05 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.934137+0000", 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6464999999999999e-05 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941032+0000", 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068944719999999996 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941265+0000", 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233105 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.952818+0000", 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011552529000000001 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.953039+0000", 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221089 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.966827+0000", 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013788442 2024-09-16T04:09:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:20 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 55.026911656999999, 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020600382, 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 20 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938602+0000", 2024-09-16T04:09:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938604+0000", 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9659999999999999e-06 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938616+0000", 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1992e-05 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938643+0000", 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7447999999999999e-05 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938662+0000", 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9269000000000001e-05 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941338+0000", 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002675242 2024-09-16T04:09:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.941576+0000", 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023854 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.943570+0000", 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019934800000000002 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.949041+0000", 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005471722 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.958969+0000", 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099272460000000007 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.959202+0000", 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233477 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:21 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 55.026803716000003, 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028407564999999999, 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 21 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938710+0000", 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938711+0000", 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4330000000000001e-06 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938719+0000", 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3189999999999995e-06 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938743+0000", 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3645000000000001e-05 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.938782+0000", 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9013000000000001e-05 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944592+0000", 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005810267 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.944817+0000", 2024-09-16T04:09:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000224904 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960092+0000", 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015274846 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.960315+0000", 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000223095 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.967117+0000", 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068020429999999998 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:58 3.as0 3:57bc9072:::smithi20431790-20:head [append 0~327680,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.992801116999999, 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023641881999999999, 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 58 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972712+0000", 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.972715+0000", 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1310000000000002e-06 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973401+0000", 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00068536200000000002 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973436+0000", 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4777000000000003e-05 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973457+0000", 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1047e-05 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973758+0000", 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000301716 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.974093+0000", 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033437899999999999 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.976226+0000", 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021329019999999999 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991758+0000", 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015532035 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996184+0000", 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0044259850000000003 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996354+0000", 2024-09-16T04:09:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017054799999999999 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:59 3.as0 3:57bc9072:::smithi20431790-20:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.992005167000002, 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023229295, 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 59 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973508+0000", 2024-09-16T04:09:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973510+0000", 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7570000000000001e-06 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973519+0000", 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9449999999999999e-06 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973678+0000", 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158815 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973702+0000", 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.461e-05 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.977799+0000", 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040967520000000004 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978040+0000", 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024069299999999999 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979318+0000", 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001278164 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991761+0000", 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012442844999999999 2024-09-16T04:09:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996561+0000", 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048005419999999997 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996738+0000", 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017617199999999999 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:60 3.as0 3:57bc9072:::smithi20431790-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.991779502999997, 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.034426401000000002, 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 60 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973734+0000", 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973736+0000", 2024-09-16T04:09:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-06 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973746+0000", 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0056e-05 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973770+0000", 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3966999999999999e-05 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.973785+0000", 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5512999999999999e-05 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979953+0000", 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061678890000000002 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980244+0000", 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029044900000000002 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.996914+0000", 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016670404999999999 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.997079+0000", 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000165126 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008160+0000", 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011081036000000001 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:64 3.as0 3:5581c6e4:::smithi20431790-22:head [append 0~360448,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.987058675, 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024425922999999999, 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 64 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978455+0000", 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.978458+0000", 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7429999999999998e-06 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979197+0000", 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00073908700000000003 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979227+0000", 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0793999999999997e-05 2024-09-16T04:09:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979247+0000", 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0078999999999999e-05 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.980478+0000", 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012303170000000001 2024-09-16T04:09:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981002+0000", 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052460899999999999 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990256+0000", 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0092540160000000003 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002501+0000", 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012244649 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002743+0000", 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024201600000000001 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002881+0000", 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137613 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:65 3.as0 3:5581c6e4:::smithi20431790-22:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.986230937999999, 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027732105, 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 65 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979283+0000", 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979284+0000", 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.711e-06 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979382+0000", 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8177999999999994e-05 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979409+0000", 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6435e-05 2024-09-16T04:09:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979459+0000", 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0192999999999999e-05 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993281+0000", 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013822302 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.993476+0000", 2024-09-16T04:09:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019474100000000001 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994583+0000", 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001106473 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003469+0000", 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088860840000000007 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.006865+0000", 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033959749999999999 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.007015+0000", 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150013 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:66 3.as0 3:5581c6e4:::smithi20431790-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.986026203999998, 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.035359943999999997, 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 66 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979487+0000", 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979489+0000", 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5999999999999999e-06 2024-09-16T04:09:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979496+0000", 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0820000000000001e-06 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979516+0000", 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9779000000000002e-05 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.979530+0000", 2024-09-16T04:09:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4198e-05 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994979+0000", 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015449176 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.995185+0000", 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000206391 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008423+0000", 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013237844 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.008619+0000", 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000195582 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.014847+0000", 2024-09-16T04:09:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062282919999999999 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:67 3.ds0 3:bc48267e:::smithi20431790-23:head [append 0~376832,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.983738590000002, 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020232841000000001, 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 67 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981775+0000", 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.981785+0000", 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6739999999999992e-06 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982754+0000", 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096953899999999995 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982787+0000", 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3216999999999997e-05 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982807+0000", 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9304e-05 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983165+0000", 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035800399999999998 2024-09-16T04:09:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983490+0000", 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032504399999999997 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.985908+0000", 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024180780000000002 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.994386+0000", 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0084781360000000007 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.001861+0000", 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074755220000000001 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.002008+0000", 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014632299999999999 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:69 3.ds0 3:bc48267e:::smithi20431790-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 54.982567222, 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.028842145999999999, 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 69 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982946+0000", 2024-09-16T04:09:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982948+0000", 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-06 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.982989+0000", 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1464999999999997e-05 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983013+0000", 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3703999999999999e-05 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.983029+0000", 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5843999999999999e-05 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.990775+0000", 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077465149999999998 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:16.991025+0000", 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024982599999999998 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003046+0000", 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012021118000000001 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.003451+0000", 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040476500000000002 2024-09-16T04:09:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:17.011788+0000", 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.008337555 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:308 3.as0 3:57bc9072:::smithi20431790-20:head [copy-from ver 2] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 44.920987249, 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020181012000000002, 2024-09-16T04:09:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 308 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044526+0000", 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044530+0000", 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8260000000000003e-06 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044545+0000", 2024-09-16T04:09:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4922999999999999e-05 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044581+0000", 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5763999999999998e-05 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044602+0000", 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1662e-05 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.044981+0000", 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000378907 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.045271+0000", 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000289945 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.058303+0000", 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013031612999999999 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.061763+0000", 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034603099999999999 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064481+0000", 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002717849 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:27.064707+0000", 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022621300000000001 2024-09-16T04:09:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:470 3.fs0 3:f2191a5d:::smithi20431790-25:head [copy-from ver 0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.112779195000002, 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.020390709999999999, 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 470 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852734+0000", 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852737+0000", 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2370000000000001e-06 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852753+0000", 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5056e-05 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852786+0000", 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3105000000000002e-05 2024-09-16T04:09:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852802+0000", 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6813e-05 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852975+0000", 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017205200000000001 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852988+0000", 2024-09-16T04:09:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.324e-05 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859023+0000", 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060348279999999999 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859276+0000", 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025340600000000002 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873125+0000", 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013848973000000001 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:471 3.fs0 3:f2191a5d:::smithi20431790-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.112671558999999, 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021425564000000001, 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 471 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852842+0000", 2024-09-16T04:09:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852843+0000", 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5000000000000001e-07 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852848+0000", 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9400000000000001e-06 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852864+0000", 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6606e-05 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852874+0000", 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9590000000000007e-06 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853159+0000", 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028422899999999999 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853179+0000", 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0692000000000001e-05 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859762+0000", 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065823050000000001 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.859940+0000", 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017856600000000001 2024-09-16T04:09:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873687+0000", 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013747120999999999 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.873971+0000", 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028401799999999998 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874267+0000", 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029617800000000002 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:472 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.112566109999999, 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.022526906999999999, 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 472 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852947+0000", 2024-09-16T04:09:12.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852949+0000", 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.753e-06 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852957+0000", 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7100000000000007e-06 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852982+0000", 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4745000000000001e-05 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.852996+0000", 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3963e-05 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853399+0000", 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00040381400000000001 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853420+0000", 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0525000000000001e-05 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860064+0000", 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066444 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.860233+0000", 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000168486 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.862013+0000", 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001780626 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874451+0000", 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.012437521 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.875343+0000", 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089236299999999997 2024-09-16T04:09:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.875474+0000", 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131001 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:473 3.fs0 3:fb02b556:::smithi20431790-7:head [rollback f] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.112501398999999, 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.023677446000000001, 2024-09-16T04:09:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 473 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853012+0000", 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853013+0000", 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.23e-07 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853017+0000", 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5059999999999997e-06 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853029+0000", 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1653e-05 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853037+0000", 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6469999999999998e-06 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853512+0000", 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000475413 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853522+0000", 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0285999999999999e-05 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.864892+0000", 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01137 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.865279+0000", 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000386857 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.868280+0000", 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030007079999999999 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874454+0000", 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006174489 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.876467+0000", 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020123160000000001 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.876689+0000", 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022274799999999999 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:474 3.fs0 3:fb02b556:::smithi20431790-7:head [append 0~0] snapc 10=[10,f,d,c,a] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 30.112437279000002, 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.024572546000000001, 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 474 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853076+0000", 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853077+0000", 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2729999999999999e-06 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853084+0000", 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9999999999999999e-06 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853106+0000", 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1063000000000001e-05 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853121+0000", 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5862000000000002e-05 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853593+0000", 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047153100000000002 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.853603+0000", 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0402e-05 2024-09-16T04:09:12.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869443+0000", 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015839776999999999 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.869707+0000", 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026354599999999997 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.872401+0000", 2024-09-16T04:09:12.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026945939999999998 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.874705+0000", 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023035640000000001 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.877404+0000", 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026990410000000001 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:41.877649+0000", 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024489299999999999 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:758 3.fs0 3:f676a78d:::smithi20431790-34:head [copy-from ver 46] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:08:57.011927+0000", 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.953586022, 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.021583906999999999, 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 758 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011927+0000", 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011927+0000", 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011930+0000", 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9799999999999998e-06 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011944+0000", 2024-09-16T04:09:12.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3739e-05 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011979+0000", 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5235999999999999e-05 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.011995+0000", 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.517e-05 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.012170+0000", 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017525200000000001 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.012464+0000", 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00029427499999999998 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.025757+0000", 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01329262 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.030738+0000", 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049816879999999997 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.033356+0000", 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026174879999999998 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:08:57.033511+0000", 2024-09-16T04:09:12.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015545899999999999 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:924 3.fs0 3:fb02b556:::smithi20431790-7:head [setxattr _header (56) in=7b] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.657034+0000", 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3084789529999998, 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.027035429, 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 924 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657034+0000", 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657034+0000", 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657036+0000", 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7990000000000001e-06 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657044+0000", 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7330000000000003e-06 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657068+0000", 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4471e-05 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657086+0000", 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7771999999999999e-05 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.662868+0000", 2024-09-16T04:09:12.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0057815590000000004 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.663153+0000", 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028562599999999998 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.664339+0000", 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001185071 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.666502+0000", 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021637589999999999 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.683706+0000", 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.017204119 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.684070+0000", 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036351999999999999 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.079 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4631.0:925 3.fs0 3:fb02b556:::smithi20431790-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-16T04:09:02.657111+0000", 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3084020140000003, 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.029622048000000002, 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4631", 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 925 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657111+0000", 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657111+0000", 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657113+0000", 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3400000000000001e-06 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657120+0000", 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2699999999999999e-06 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657142+0000", 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2095000000000001e-05 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.657158+0000", 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5631e-05 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.664933+0000", 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077752000000000003 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.665153+0000", 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022049099999999999 2024-09-16T04:09:12.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.684157+0000", 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019003596000000001 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.684245+0000", 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8301999999999996e-05 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-16T04:09:02.686733+0000", 2024-09-16T04:09:12.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024881230000000001 2024-09-16T04:09:12.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-16T04:09:12.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-16T04:09:12.085 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-16T04:09:12.086 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-16T04:09:12.086 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-16T04:09:12.087 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T04:09:12.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-16T04:09:12.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-16T04:09:12.221 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:12.222 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:12.222 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:09:12.222 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:12.236 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-16T04:09:12.360 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:12.361 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:12.361 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:09:12.361 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:09:12.361 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:12.374 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=0, reqid=client.4631.0:16, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.553336289000001, 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088452600000000006, 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.493 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.494 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937562+0000", 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7599999999999997e-07 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937675+0000", 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000112378 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937696+0000", 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1192e-05 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.495 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937716+0000", 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9786e-05 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937875+0000", 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015905699999999999 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.937897+0000", 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2442999999999998e-05 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.496 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946338+0000", 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0084413119999999994 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946407+0000", 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8516000000000006e-05 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.497 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 33/31 ECSubWrite(tid=1, reqid=client.4631.0:17, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.551744730999999, 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073144209999999998, 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.498 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939153+0000", 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939155+0000", 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.823e-06 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939194+0000", 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9060999999999998e-05 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.499 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939224+0000", 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0009e-05 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939288+0000", 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4290999999999998e-05 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939471+0000", 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018293899999999999 2024-09-16T04:09:12.500 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.939493+0000", 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1849999999999999e-05 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946414+0000", 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069205860000000003 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946468+0000", 2024-09-16T04:09:12.501 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3862e-05 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=0, reqid=client.4631.0:34, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.536965152000001, 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010827755999999999, 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.502 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953933+0000", 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.953934+0000", 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3099999999999996e-07 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.503 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955299+0000", 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001365401 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955338+0000", 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8804000000000003e-05 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955361+0000", 2024-09-16T04:09:12.504 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3472000000000002e-05 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000184064 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955568+0000", 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2425e-05 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.505 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964640+0000", 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090716189999999995 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.964761+0000", 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012104000000000001 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 34/31 ECSubWrite(tid=2, reqid=client.4631.0:17, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:12.506 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.534528659000003, 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093557269999999994, 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.507 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956369+0000", 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956371+0000", 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9069999999999999e-06 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.508 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956399+0000", 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7784999999999999e-05 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956441+0000", 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1727999999999998e-05 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956464+0000", 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2991999999999999e-05 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.509 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956620+0000", 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015645500000000001 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956649+0000", 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8438000000000001e-05 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965629+0000", 2024-09-16T04:09:12.510 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089807140000000008 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965725+0000", 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.5707999999999999e-05 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 34/31 ECSubWrite(tid=2, reqid=client.4631.0:5, at_version=0'0, trim_to=0'0, roll_forward_to=33'2))", 2024-09-16T04:09:12.511 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.534309507000003, 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092008920000000004, 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956589+0000", 2024-09-16T04:09:12.512 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956590+0000", 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5060000000000001e-06 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956611+0000", 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1123000000000001e-05 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.513 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956633+0000", 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1464999999999999e-05 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956651+0000", 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8113000000000001e-05 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956835+0000", 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018435000000000001 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.514 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956855+0000", 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9629000000000001e-05 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965720+0000", 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088648259999999993 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965789+0000", 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.9880000000000002e-05 2024-09-16T04:09:12.515 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 34/31 ECSubWrite(tid=1, reqid=client.4631.0:35, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.531518955999999, 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006492589, 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.516 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959379+0000", 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959380+0000", 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.42e-06 2024-09-16T04:09:12.517 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959416+0000", 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5373000000000002e-05 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959452+0000", 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6328999999999997e-05 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.518 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959471+0000", 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8991000000000002e-05 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959623+0000", 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015206900000000001 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.519 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.959635+0000", 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1712000000000001e-05 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965813+0000", 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061778650000000003 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965872+0000", 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8829999999999997e-05 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.520 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.ds5 34/31 ECSubWrite(tid=13, reqid=client.4631.0:67, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.504719868999999, 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0064133979999999998, 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.521 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986178+0000", 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.522 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986180+0000", 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.61e-06 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986500+0000", 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00032045199999999999 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986536+0000", 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.5522999999999999e-05 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.523 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986565+0000", 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9445999999999999e-05 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986758+0000", 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019237 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986779+0000", 2024-09-16T04:09:12.524 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1359e-05 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992509+0000", 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0057302610000000004 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992592+0000", 2024-09-16T04:09:12.525 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2377000000000001e-05 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 41.638116433, 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094335619999999995, 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.526 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852782+0000", 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3300000000000001e-07 2024-09-16T04:09:12.527 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852840+0000", 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8068e-05 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852875+0000", 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4016000000000001e-05 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.528 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.852916+0000", 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1301000000000003e-05 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853436+0000", 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052021800000000003 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853462+0000", 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5602e-05 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.529 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.530 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.530 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862103+0000", 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0086416559999999993 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862215+0000", 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011186799999999999 2024-09-16T04:09:12.532 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 48/31 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=48'13, trim_to=0'0, roll_forward_to=44'11))", 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 41.637598949000001, 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088015860000000001, 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.533 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853299+0000", 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853300+0000", 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9299999999999998e-07 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.534 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853354+0000", 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.3897999999999998e-05 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853383+0000", 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9689e-05 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853406+0000", 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2289e-05 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.535 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853644+0000", 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023859799999999999 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.853670+0000", 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5609000000000002e-05 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.536 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.861999+0000", 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083290640000000006 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:30.862101+0000", 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000101846 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.537 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 54/31 ECSubWrite(tid=97, reqid=osd.13.0:97, at_version=54'27, trim_to=0'0, roll_forward_to=52'25))", 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 35.416821573999997, 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006242633, 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.538 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074076+0000", 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074077+0000", 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8299999999999995e-07 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074158+0000", 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0173999999999995e-05 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.539 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074189+0000", 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1086e-05 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074228+0000", 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9184999999999998e-05 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074411+0000", 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018316400000000001 2024-09-16T04:09:12.540 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.074437+0000", 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6023000000000001e-05 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080222+0000", 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.005785241 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080319+0000", 2024-09-16T04:09:12.541 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6877000000000001e-05 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 54/31 ECSubWrite(tid=75, reqid=osd.5.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=54'21))", 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 35.401466915999997, 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062013679999999996, 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.542 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089431+0000", 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089433+0000", 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0470000000000001e-06 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.543 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089464+0000", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0451999999999999e-05 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089503+0000", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9721999999999997e-05 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089528+0000", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4375999999999998e-05 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089700+0000", 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017223499999999999 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.089724+0000", 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4485999999999999e-05 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.095544+0000", 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058195529999999999 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.545 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.095632+0000", 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8497000000000003e-05 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 60/31 ECSubWrite(tid=39, reqid=osd.8.0:39, at_version=60'27, trim_to=0'0, roll_forward_to=57'25))", 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 29.608741029000001, 2024-09-16T04:09:12.546 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069862259999999999, 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882157+0000", 2024-09-16T04:09:12.547 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882158+0000", 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0130000000000001e-06 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882227+0000", 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8670999999999994e-05 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.548 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882263+0000", 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6729e-05 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882287+0000", 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3963000000000001e-05 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882459+0000", 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00017120899999999999 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.549 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.882486+0000", 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7611999999999999e-05 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889027+0000", 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065408530000000001 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889143+0000", 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00011617599999999999 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.550 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 63/31 ECSubWrite(tid=110, reqid=client.4631.0:509, at_version=63'54, trim_to=0'0, roll_forward_to=63'53))", 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 26.314069620000001, 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0073621579999999997, 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.551 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176828+0000", 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.176830+0000", 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0760000000000001e-06 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.552 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179214+0000", 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0023831529999999998 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179253+0000", 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.9088999999999998e-05 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179284+0000", 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0905000000000003e-05 2024-09-16T04:09:12.553 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179490+0000", 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020643500000000001 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.179520+0000", 2024-09-16T04:09:12.554 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9822999999999999e-05 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184081+0000", 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0045612500000000002 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.184191+0000", 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010942699999999999 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.555 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 64/31 ECSubWrite(tid=114, reqid=osd.5.0:113, at_version=0'0, trim_to=0'0, roll_forward_to=64'58))", 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 25.561251593000001, 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098458810000000008, 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.556 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929646+0000", 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929652+0000", 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929681+0000", 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9323e-05 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929713+0000", 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1639e-05 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929735+0000", 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2246e-05 2024-09-16T04:09:12.558 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929957+0000", 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022144100000000001 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929982+0000", 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5636e-05 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.939392+0000", 2024-09-16T04:09:12.559 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0094095789999999995 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.939492+0000", 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000100444 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 75/31 ECSubWrite(tid=189, reqid=osd.13.0:189, at_version=75'49, trim_to=0'0, roll_forward_to=74'47))", 2024-09-16T04:09:12.560 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:57.868090+0000", 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.622808175999999, 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012454742, 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.868090+0000", 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.561 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.868090+0000", 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.868091+0000", 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.5700000000000001e-07 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.868134+0000", 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.3182000000000001e-05 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.868161+0000", 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7036999999999999e-05 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.868179+0000", 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7898999999999999e-05 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.869161+0000", 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0009822819999999999 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.869190+0000", 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8575999999999999e-05 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.880448+0000", 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011258308 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.880545+0000", 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6601000000000006e-05 2024-09-16T04:09:12.564 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.fs6 75/31 ECSubWrite(tid=191, reqid=osd.13.0:191, at_version=75'51, trim_to=0'0, roll_forward_to=74'47))", 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:57.875783+0000", 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.615114705, 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0067459379999999999, 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.565 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.875783+0000", 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.875783+0000", 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.875786+0000", 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.897e-06 2024-09-16T04:09:12.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.875845+0000", 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8779000000000001e-05 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.875879+0000", 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3878999999999999e-05 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.567 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.875901+0000", 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2612999999999998e-05 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.876152+0000", 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000250991 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.876178+0000", 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5133000000000001e-05 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.568 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.882343+0000", 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061655470000000004 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.882529+0000", 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018609900000000001 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 75/31 ECSubWrite(tid=83, reqid=osd.8.0:83, at_version=75'59, trim_to=0'0, roll_forward_to=74'57))", 2024-09-16T04:09:12.569 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:57.879223+0000", 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 14.611675306, 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071065269999999996, 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.879223+0000", 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.570 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.879223+0000", 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.879224+0000", 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1999999999999999e-06 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.571 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.879281+0000", 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7105999999999998e-05 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.879322+0000", 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1142e-05 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.879346+0000", 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3560000000000001e-05 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.572 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.880025+0000", 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00067936199999999998 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.880050+0000", 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4516e-05 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.886236+0000", 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061867930000000003 2024-09-16T04:09:12.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.886329+0000", 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.2848000000000003e-05 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.es4 79/31 ECSubWrite(tid=89, reqid=osd.8.0:89, at_version=79'65, trim_to=0'0, roll_forward_to=77'63))", 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.898137+0000", 2024-09-16T04:09:12.574 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.592760771, 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0065976949999999998, 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.898137+0000", 2024-09-16T04:09:12.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.898137+0000", 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.898138+0000", 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0070000000000001e-06 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.898215+0000", 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.7038000000000003e-05 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.898248+0000", 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2410000000000003e-05 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.898271+0000", 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3309e-05 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.899904+0000", 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001633458 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.899932+0000", 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7172999999999999e-05 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.904637+0000", 2024-09-16T04:09:12.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0047048649999999999 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.904735+0000", 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.8435000000000002e-05 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s2 79/31 ECSubWrite(tid=80, reqid=osd.15.0:79, at_version=0'0, trim_to=0'0, roll_forward_to=79'52))", 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.914454+0000", 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.576444486, 2024-09-16T04:09:12.579 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0075289429999999997, 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914454+0000", 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914454+0000", 2024-09-16T04:09:12.580 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914456+0000", 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0959999999999999e-06 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914485+0000", 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9070000000000001e-05 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914518+0000", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3339e-05 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914541+0000", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.251e-05 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914706+0000", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016497699999999999 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.914736+0000", 2024-09-16T04:09:12.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0669000000000001e-05 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.921889+0000", 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00715308 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.921982+0000", 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3202000000000007e-05 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.583 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.cs5 79/31 ECSubWrite(tid=166, reqid=osd.5.0:164, at_version=0'0, trim_to=0'0, roll_forward_to=79'73))", 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.915883+0000", 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.575015058, 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006733579, 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.915883+0000", 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.584 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.915883+0000", 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.915885+0000", 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9970000000000001e-06 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.915914+0000", 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8972999999999999e-05 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.915946+0000", 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2079000000000002e-05 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.915969+0000", 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2537000000000001e-05 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.916136+0000", 2024-09-16T04:09:12.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016764899999999999 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.916162+0000", 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5530000000000001e-05 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.922516+0000", 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006354396 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.922617+0000", 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000100418 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:12.588 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:12.589 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-16T04:09:12.717 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:12.717 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:12.718 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:09:12.718 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:12.731 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-16T04:09:12.849 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:12.849 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:12.849 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:09:12.849 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:09:12.849 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:12.865 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-16T04:09:12.991 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-16T04:09:12.992 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.4 to 1 (10000) 2024-09-16T04:09:12.994 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:12.994 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:09:12.994 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:09:12.994 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:09:12.994 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.994 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:76 3.1s0 3:8cd578d6:::smithi20431790-26:head [append 0~425984,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.999298439, 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016989746999999999, 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 76 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.995 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990723+0000", 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.996 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990725+0000", 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7659999999999999e-06 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991908+0000", 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011824369999999999 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.997 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991959+0000", 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.1104999999999999e-05 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.991974+0000", 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.507e-05 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992175+0000", 2024-09-16T04:09:12.998 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000200748 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992429+0000", 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025421900000000003 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.994438+0000", 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0020088559999999998 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:12.999 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.000632+0000", 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061938200000000001 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007596+0000", 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0069640379999999997 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.000 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007712+0000", 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000116688 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:77 3.1s0 3:8cd578d6:::smithi20431790-26:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.998006091999997, 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016129303000000001, 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.001 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 77 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:09:13.002 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992015+0000", 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992016+0000", 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.142e-06 2024-09-16T04:09:13.003 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992029+0000", 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2622e-05 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992042+0000", 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3453e-05 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.004 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992050+0000", 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0830000000000004e-06 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996215+0000", 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0041647710000000003 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.005 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996322+0000", 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000106525 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996924+0000", 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00060262499999999997 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.001154+0000", 2024-09-16T04:09:13.006 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0042302959999999997 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.007954+0000", 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.006799462 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008144+0000", 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019032399999999999 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.007 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:78 3.1s0 3:8cd578d6:::smithi20431790-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 55.997873407, 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019834738000000001, 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.008 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 78 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.009 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992148+0000", 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6300000000000004e-07 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992154+0000", 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5350000000000004e-06 2024-09-16T04:09:13.010 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992164+0000", 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0467e-05 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.992176+0000", 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1438e-05 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.011 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.997489+0000", 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053126850000000002 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.997713+0000", 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000224797 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.012 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008726+0000", 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011012533999999999 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.008813+0000", 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6673000000000002e-05 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:17.011982+0000", 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0031697460000000002 2024-09-16T04:09:13.013 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 54/31 ECSubWrite(tid=185, reqid=osd.10.0:185, at_version=54'85, trim_to=0'0, roll_forward_to=53'83))", 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070990+0000", 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 35.919030829999997, 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011792231, 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.014 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070990+0000", 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070990+0000", 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.015 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070992+0000", 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6500000000000001e-06 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071044+0000", 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2098999999999997e-05 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.016 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071074+0000", 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0232000000000001e-05 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071096+0000", 2024-09-16T04:09:13.017 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1702999999999999e-05 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071318+0000", 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022174599999999999 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.071343+0000", 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5741999999999998e-05 2024-09-16T04:09:13.018 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.082689+0000", 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011345668999999999 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.082782+0000", 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.3389999999999999e-05 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.019 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(osd.10.22:7 3.1s0 3:8c94f6f5:::smithi20431790-36:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.864847+0000", 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 30.125174144999999, 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015069387, 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.020 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864847+0000", 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864847+0000", 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.021 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864851+0000", 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.0439999999999997e-06 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864867+0000", 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6348999999999999e-05 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.022 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864909+0000", 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1579000000000003e-05 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864934+0000", 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4763e-05 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.865127+0000", 2024-09-16T04:09:13.023 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019343400000000001 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "op must wait for map", 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.865149+0000", 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2269e-05 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.871299+0000", 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0061497219999999998 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.024 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.871534+0000", 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023460899999999999 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879916+0000", 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0083826179999999997 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.025 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs1 60/31 ECSubWrite(tid=212, reqid=osd.10.0:212, at_version=60'106, trim_to=0'0, roll_forward_to=57'102))", 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 30.110995456000001, 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011330115999999999, 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:09:13.026 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879026+0000", 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6000000000000002e-07 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.027 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879100+0000", 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.3211000000000001e-05 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879123+0000", 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3422999999999999e-05 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.028 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879140+0000", 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7033000000000001e-05 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.880405+0000", 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0012647100000000001 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.880431+0000", 2024-09-16T04:09:13.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.6529e-05 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.890246+0000", 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098149099999999996 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.890356+0000", 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010944 2024-09-16T04:09:13.030 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.3s5 75/31 ECSubWrite(tid=73, reqid=osd.15.0:73, at_version=75'46, trim_to=0'0, roll_forward_to=74'44))", 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:57.883424+0000", 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 15.106597342000001, 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010728878000000001, 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.031 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883424+0000", 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883424+0000", 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883424+0000", 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1999999999999999e-07 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883477+0000", 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2698999999999998e-05 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883508+0000", 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1226000000000002e-05 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883531+0000", 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2503000000000001e-05 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883776+0000", 2024-09-16T04:09:13.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024551800000000002 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.883802+0000", 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5459000000000001e-05 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.894053+0000", 2024-09-16T04:09:13.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010251212000000001 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:57.894153+0000", 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9541000000000001e-05 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:863 3.1s0 3:8cd578d6:::smithi20431790-26:head [append 0~688128] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.036 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.202680+0000", 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.787341273999999, 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.014834352, 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 863 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.037 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.202680+0000", 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.202680+0000", 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.202682+0000", 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1430000000000001e-06 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.204088+0000", 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001405919 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.039 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.204117+0000", 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9275999999999999e-05 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.204137+0000", 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9576e-05 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.204259+0000", 2024-09-16T04:09:13.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012270799999999999 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.204397+0000", 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00013721100000000001 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.206483+0000", 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0020866259999999998 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208480+0000", 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001996364 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.217309+0000", 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088291029999999996 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.217514+0000", 2024-09-16T04:09:13.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020542600000000001 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:864 3.1s0 3:8cd578d6:::smithi20431790-26:head [append 0~475136] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.205747+0000", 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.784274380999999, 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012881158, 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.043 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 864 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.205747+0000", 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.044 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.205747+0000", 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.205748+0000", 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5269999999999999e-06 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.206570+0000", 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00082218099999999995 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.206602+0000", 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1581999999999997e-05 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.206622+0000", 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9956999999999999e-05 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208910+0000", 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0022876179999999999 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.209039+0000", 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000129617 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.047 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.210695+0000", 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0016556979999999999 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.216926+0000", 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0062313680000000001 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.218397+0000", 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0014706280000000001 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.218628+0000", 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023098199999999999 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.049 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:865 3.1s0 3:8cd578d6:::smithi20431790-26:head [append 0~393216] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.208333+0000", 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.781687778, 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011485835, 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 865 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.050 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208333+0000", 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208333+0000", 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208335+0000", 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.863e-06 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208751+0000", 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00041585899999999998 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.052 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208779+0000", 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8285000000000001e-05 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208799+0000", 2024-09-16T04:09:13.053 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9616999999999999e-05 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.212340+0000", 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003541294 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.212882+0000", 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00054166299999999995 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.214810+0000", 2024-09-16T04:09:13.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0019277649999999999 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.217817+0000", 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.003007628 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.219620+0000", 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0018027049999999999 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.219819+0000", 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000199156 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:866 3.1s0 3:8cd578d6:::smithi20431790-26:head [setxattr _header (57) in=7b] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.208831+0000", 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.781189798, 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019813126, 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.056 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 866 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208831+0000", 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.057 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208831+0000", 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208833+0000", 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7e-06 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208842+0000", 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.0929999999999992e-06 2024-09-16T04:09:13.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208862+0000", 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9956e-05 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208877+0000", 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5023e-05 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.220862+0000", 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011984493000000001 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.221114+0000", 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025280799999999998 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.060 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.222220+0000", 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011057689999999999 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.227241+0000", 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0050205279999999998 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.061 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.227432+0000", 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019132700000000001 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.228644+0000", 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0012124289999999999 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.062 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:867 3.1s0 3:8cd578d6:::smithi20431790-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.208899+0000", 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.781122286, 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.035684525000000002, 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 867 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.063 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208899+0000", 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208899+0000", 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208900+0000", 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.33e-06 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208908+0000", 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3729999999999993e-06 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208928+0000", 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9059000000000002e-05 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208947+0000", 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9347e-05 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.222827+0000", 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013880152 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.223040+0000", 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021344300000000001 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.066 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.228768+0000", 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0057278709999999998 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.228999+0000", 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00023072899999999999 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.244583+0000", 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015584221000000001 2024-09-16T04:09:13.067 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 79/31 ECSubWriteReply(tid=28, last_complete=79'16, committed=1, applied=1))", 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.229401+0000", 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.760619820000001, 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012818046, 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229401+0000", 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229401+0000", 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229403+0000", 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.57e-06 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229411+0000", 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.4829999999999999e-06 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229430+0000", 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8983000000000001e-05 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229442+0000", 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1823e-05 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.071 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242149+0000", 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012707181999999999 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242219+0000", 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.0005000000000005e-05 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.072 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 79/31 ECSubWriteReply(tid=28, last_complete=79'16, committed=1, applied=1))", 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.229577+0000", 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.760444527000001, 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012810686, 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229577+0000", 2024-09-16T04:09:13.073 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229577+0000", 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229578+0000", 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0070000000000001e-06 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229583+0000", 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9259999999999997e-06 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229601+0000", 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7503000000000002e-05 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.075 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229615+0000", 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3753e-05 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242330+0000", 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012715145000000001 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242387+0000", 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.7352000000000002e-05 2024-09-16T04:09:13.076 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 79/31 ECSubWriteReply(tid=28, last_complete=79'16, committed=1, applied=1))", 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.229671+0000", 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.760350012, 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012824149, 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.077 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229671+0000", 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229671+0000", 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.078 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229679+0000", 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5800000000000003e-06 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229689+0000", 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0193e-05 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229706+0000", 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6719e-05 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229716+0000", 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0886999999999999e-05 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242457+0000", 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012740121 2024-09-16T04:09:13.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242495+0000", 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8649000000000002e-05 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 79/31 ECSubWriteReply(tid=28, last_complete=79'16, committed=1, applied=1))", 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.229923+0000", 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.760098114, 2024-09-16T04:09:13.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012680822, 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229923+0000", 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.082 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229923+0000", 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229925+0000", 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.807e-06 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229936+0000", 2024-09-16T04:09:13.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1440000000000001e-05 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229961+0000", 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4892000000000002e-05 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.229980+0000", 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9317000000000002e-05 2024-09-16T04:09:13.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242563+0000", 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012582347000000001 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242604+0000", 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.1019000000000001e-05 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.085 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 79/31 ECSubWriteReply(tid=28, last_complete=79'16, committed=1, applied=1))", 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.230042+0000", 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.759978743, 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012664289, 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.086 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230042+0000", 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230042+0000", 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230057+0000", 2024-09-16T04:09:13.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.488e-05 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230067+0000", 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7860000000000008e-06 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230091+0000", 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3572999999999999e-05 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230107+0000", 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6076e-05 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242668+0000", 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012561114999999999 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242707+0000", 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8859000000000002e-05 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 79/31 ECSubWriteReply(tid=28, last_complete=79'16, committed=1, applied=1))", 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.230292+0000", 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.759728851, 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012568833999999999, 2024-09-16T04:09:13.090 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230292+0000", 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230292+0000", 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230294+0000", 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.243e-06 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230307+0000", 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.238e-05 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230338+0000", 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.1600000000000002e-05 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.230358+0000", 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9949000000000002e-05 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242769+0000", 2024-09-16T04:09:13.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012410574000000001 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242861+0000", 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.2088000000000003e-05 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpReadReply(3.1s0 79/31 ECSubReadReply(tid=29, attrs_read=0))", 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.231081+0000", 2024-09-16T04:09:13.094 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.758940312, 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011947658999999999, 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.231081+0000", 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.231081+0000", 2024-09-16T04:09:13.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.231082+0000", 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7579999999999999e-06 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.231107+0000", 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4039000000000001e-05 2024-09-16T04:09:13.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.231130+0000", 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3147e-05 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.231144+0000", 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4810000000000001e-05 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.242932+0000", 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011787737 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.243028+0000", 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6168000000000005e-05 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:904 3.1s0 3:8c94f6f5:::smithi20431790-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.568476+0000", 2024-09-16T04:09:13.098 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.421545424, 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013088274, 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 904 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.568476+0000", 2024-09-16T04:09:13.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.568476+0000", 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.568477+0000", 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.063e-06 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.568481+0000", 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.4700000000000004e-06 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.568496+0000", 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5282999999999999e-05 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.568504+0000", 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9330000000000001e-06 2024-09-16T04:09:13.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.578968+0000", 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010463769 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.579208+0000", 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024032200000000001 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.581564+0000", 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.002355434 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.103 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:13.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-16T04:09:13.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-16T04:09:13.232 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:13.233 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:13.233 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:09:13.233 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:13.246 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-16T04:09:13.364 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:13.365 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:13.365 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:09:13.365 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:09:13.365 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:13.378 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-16T04:09:13.505 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:13.505 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:09:13.505 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:09:13.505 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:3 3.4s0 3:23761325:::smithi20431790-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.568692966, 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.046611916000000003, 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 3 2024-09-16T04:09:13.506 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932939+0000", 2024-09-16T04:09:13.507 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932940+0000", 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1799999999999999e-06 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932969+0000", 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8867e-05 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.508 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.932988+0000", 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9173000000000001e-05 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.933004+0000", 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5821999999999999e-05 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941757+0000", 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0087529989999999992 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.509 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941968+0000", 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021104500000000001 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958099+0000", 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016130480999999999 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958362+0000", 2024-09-16T04:09:13.510 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026272900000000001 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.979551+0000", 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021189619999999999 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.511 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:15 3.bs0 3:ddc630b6:::smithi20431790-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.567616833000002, 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044909575, 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.512 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 15 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.513 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934015+0000", 2024-09-16T04:09:13.514 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934017+0000", 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.302e-06 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.515 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934023+0000", 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2140000000000001e-06 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934039+0000", 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5690999999999999e-05 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.934052+0000", 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3728e-05 2024-09-16T04:09:13.516 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955822+0000", 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.021769189000000001 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.956014+0000", 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019218999999999999 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.517 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963151+0000", 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00713688 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.963673+0000", 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00052261899999999999 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978925+0000", 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015251762 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.518 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:24 3.4s0 3:20db2d5a:::smithi20431790-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.560391989999999, 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039181856000000001, 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.519 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 24 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.520 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941240+0000", 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941242+0000", 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4670000000000001e-06 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941248+0000", 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2519999999999996e-06 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.521 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941266+0000", 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8502999999999999e-05 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.941281+0000", 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4642e-05 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949167+0000", 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0078853970000000006 2024-09-16T04:09:13.522 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949385+0000", 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000218929 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961609+0000", 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012224016000000001 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.961801+0000", 2024-09-16T04:09:13.523 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019127200000000001 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.980422+0000", 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018621378000000001 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:28 3.4s0 3:29c49be6:::smithi20431790-10:head [append 0~163840,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:09:13.524 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.556148151999999, 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039204422000000003, 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 28 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.525 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945484+0000", 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945486+0000", 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:09:13.526 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945810+0000", 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000323713 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945834+0000", 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3858000000000001e-05 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945851+0000", 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7099999999999999e-05 2024-09-16T04:09:13.527 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965628+0000", 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019777501999999999 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.965920+0000", 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00029198400000000002 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.967512+0000", 2024-09-16T04:09:13.528 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015920190000000001 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984489+0000", 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016976872 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984601+0000", 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000111969 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.529 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984689+0000", 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7554999999999998e-05 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:29 3.4s0 3:29c49be6:::smithi20431790-10:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.555753549000002, 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041668905999999999, 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.530 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 29 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.531 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945879+0000", 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945880+0000", 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7060000000000001e-06 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945888+0000", 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8630000000000008e-06 2024-09-16T04:09:13.532 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945906+0000", 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8165e-05 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945921+0000", 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4233000000000001e-05 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.533 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.969983+0000", 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.024062503999999998 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.970182+0000", 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000198784 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.975849+0000", 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0056673210000000003 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.534 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.984708+0000", 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088582690000000002 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987208+0000", 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0025007359999999999 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987548+0000", 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033932500000000002 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.535 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:30 3.4s0 3:29c49be6:::smithi20431790-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.555665853999997, 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.044609479, 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 30 2024-09-16T04:09:13.536 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945966+0000", 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.537 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945968+0000", 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5629999999999999e-06 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945975+0000", 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.063e-06 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.945994+0000", 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9415999999999998e-05 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.538 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946009+0000", 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4969e-05 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978603+0000", 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.032593521 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.978799+0000", 2024-09-16T04:09:13.539 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000196336 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987651+0000", 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0088521820000000001 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.987845+0000", 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019347900000000001 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.540 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.990576+0000", 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027309499999999998 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:47 3.4s0 3:285c2ad8:::smithi20431790-16:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.543739062, 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.037486141000000001, 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.541 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 47 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.542 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957893+0000", 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957895+0000", 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6950000000000001e-06 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957903+0000", 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8679999999999999e-06 2024-09-16T04:09:13.543 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957923+0000", 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0001e-05 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957942+0000", 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9368000000000002e-05 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.544 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985229+0000", 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.027287148000000001 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.985602+0000", 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00037240199999999998 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.986575+0000", 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00097305500000000001 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.545 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989838+0000", 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0032630300000000001 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995213+0000", 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0053754359999999999 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.995379+0000", 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000166138 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.546 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:48 3.4s0 3:285c2ad8:::smithi20431790-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 56.543670368000001, 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.041004387000000003, 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.547 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 48 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957962+0000", 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.548 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957963+0000", 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.437e-06 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957969+0000", 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8370000000000002e-06 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957990+0000", 2024-09-16T04:09:13.549 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0883999999999999e-05 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958003+0000", 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3377000000000001e-05 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.988975+0000", 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030971772000000002 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.989143+0000", 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016802000000000001 2024-09-16T04:09:13.550 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996033+0000", 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0068901420000000001 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.996181+0000", 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014787700000000001 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.998966+0000", 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0027850409999999998 2024-09-16T04:09:13.551 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:477 3.bs0 3:dc3e14e2:::smithi20431790-29:head [copy-from ver 8] snapc 10=[10,f,c,a] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.859960+0000", 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 30.641671786, 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.042464367000000003, 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.552 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 477 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859960+0000", 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859960+0000", 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.553 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859964+0000", 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3189999999999999e-06 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.859978+0000", 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4724e-05 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.554 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860015+0000", 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.6298999999999999e-05 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860039+0000", 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4278999999999999e-05 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860194+0000", 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000154976 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.555 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "op must wait for map", 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860209+0000", 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5279000000000001e-05 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864305+0000", 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040955130000000003 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864563+0000", 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00025807299999999999 2024-09-16T04:09:13.556 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.891237+0000", 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.026674131 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.901977+0000", 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010740387000000001 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.557 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.558 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.902163+0000", 2024-09-16T04:09:13.558 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00018583900000000001 2024-09-16T04:09:13.558 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.558 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.558 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.560 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.902425+0000", 2024-09-16T04:09:13.560 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00026154800000000001 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:478 3.bs0 3:dc3e14e2:::smithi20431790-29:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.860089+0000", 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 30.641542863000002, 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.035771745000000001, 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.561 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 478 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860089+0000", 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.562 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860089+0000", 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860091+0000", 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.463e-06 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860099+0000", 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0930000000000003e-06 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.563 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860121+0000", 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1702999999999999e-05 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860164+0000", 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.3639e-05 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860364+0000", 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00019981400000000001 2024-09-16T04:09:13.564 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.860383+0000", 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8522e-05 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864818+0000", 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0044352209999999996 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.565 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.864897+0000", 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9128000000000005e-05 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.895268+0000", 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.030371056 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.895547+0000", 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00027891800000000002 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.566 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.895861+0000", 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00031418800000000002 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:876 3.4s0 3:285c2ad8:::smithi20431790-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.226226+0000", 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.275406028999999, 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.035717330999999998, 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.567 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 876 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226226+0000", 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.568 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226226+0000", 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226228+0000", 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5770000000000001e-06 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.569 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226236+0000", 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0830000000000004e-06 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226249+0000", 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3046e-05 2024-09-16T04:09:13.570 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226264+0000", 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.505e-05 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.239488+0000", 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013223626 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.239657+0000", 2024-09-16T04:09:13.571 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016967600000000001 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.249698+0000", 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010040321 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.249935+0000", 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000237044 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.572 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.261944+0000", 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012008908 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:881 3.4s0 3:20adce66:::smithi20431790-50:18 [read 0~3653632,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.226568+0000", 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.275063984999999, 2024-09-16T04:09:13.573 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.034804768999999999, 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 881 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.574 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226568+0000", 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226568+0000", 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.575 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226569+0000", 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0130000000000001e-06 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226574+0000", 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.6829999999999999e-06 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.576 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226584+0000", 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7929999999999992e-06 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226592+0000", 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.7770000000000002e-06 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.246438+0000", 2024-09-16T04:09:13.577 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019846928999999999 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.246668+0000", 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022968700000000001 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.261373+0000", 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.014704887 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.578 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:882 3.4s0 3:20adce66:::smithi20431790-50:18 [read 0~3653632,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.226601+0000", 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.275031643, 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.038067754000000002, 2024-09-16T04:09:13.579 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 882 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226601+0000", 2024-09-16T04:09:13.580 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226601+0000", 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226601+0000", 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4000000000000001e-07 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.581 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226605+0000", 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7529999999999999e-06 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226615+0000", 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.7140000000000005e-06 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.226627+0000", 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2466000000000001e-05 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.582 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.251614+0000", 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.024986532999999998 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.251710+0000", 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6088000000000006e-05 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.583 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.264668+0000", 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01295846 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:913 3.bs0 3:dc3e14e2:::smithi20431790-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.654534+0000", 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.847098709000001, 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.033746730000000003, 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.584 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 913 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654534+0000", 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654534+0000", 2024-09-16T04:09:13.585 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654535+0000", 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3740000000000001e-06 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654541+0000", 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.93e-06 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.586 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654578+0000", 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7462000000000001e-05 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654594+0000", 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5756999999999998e-05 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.663347+0000", 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.008753238 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.587 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.663593+0000", 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024576200000000001 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.680975+0000", 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.017382390000000001 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.681174+0000", 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0001984 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.588 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.688280+0000", 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0071064170000000003 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:914 3.bs0 3:de4d7231:::smithi20431790-45:head [copy-from ver 149] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.654619+0000", 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.847012836999999, 2024-09-16T04:09:13.589 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.051029286, 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 914 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654619+0000", 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.590 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654619+0000", 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654621+0000", 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.423e-06 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654628+0000", 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4399999999999999e-06 2024-09-16T04:09:13.591 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654653+0000", 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4473000000000001e-05 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654668+0000", 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.499e-05 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.592 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.663715+0000", 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090471289999999992 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.663963+0000", 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024784200000000002 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.697242+0000", 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.033279709999999997 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.593 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.705326+0000", 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.008083392 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.705561+0000", 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000235684 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.705649+0000", 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.7202999999999998e-05 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.594 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:915 3.bs0 3:de4d7231:::smithi20431790-45:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.654687+0000", 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.846945482000001, 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.049959330000000003, 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 915 2024-09-16T04:09:13.595 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654687+0000", 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654687+0000", 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654688+0000", 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3599999999999999e-06 2024-09-16T04:09:13.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654694+0000", 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.6570000000000002e-06 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654712+0000", 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7966999999999999e-05 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.597 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.654726+0000", 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4321999999999999e-05 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.664477+0000", 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0097512290000000001 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.664605+0000", 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00012819099999999999 2024-09-16T04:09:13.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.704279+0000", 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.039673736000000001 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.704481+0000", 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00020138099999999999 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.704646+0000", 2024-09-16T04:09:13.599 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000165487 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:928 3.bs0 3:ddc4ce43:::smithi20431790-30:head [append 0~0] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.657980+0000", 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.843652406, 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.047256810000000003, 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.600 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 928 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.657980+0000", 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.601 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.657980+0000", 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.657981+0000", 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1629999999999999e-06 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.657986+0000", 2024-09-16T04:09:13.602 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.113e-06 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.658006+0000", 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9493000000000001e-05 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.658019+0000", 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3869999999999999e-05 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.683655+0000", 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.025635726000000001 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.683887+0000", 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000232055 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:13.604 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.685454+0000", 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0015668920000000001 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.688702+0000", 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0032480809999999999 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.705148+0000", 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.016445872 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.605 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.705237+0000", 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8545e-05 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:933 3.4s0 3:23761325:::smithi20431790-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.665915+0000", 2024-09-16T04:09:13.606 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.835717347999999, 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.043884758000000003, 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 933 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.665915+0000", 2024-09-16T04:09:13.607 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.665915+0000", 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.665916+0000", 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.246e-06 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.608 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.665924+0000", 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0299999999999994e-06 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.665943+0000", 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8337000000000001e-05 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.665959+0000", 2024-09-16T04:09:13.609 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6056e-05 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.680862+0000", 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.014902996 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.681083+0000", 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00022157500000000001 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.610 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.691683+0000", 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010599842999999999 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.691924+0000", 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024090200000000001 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.709800+0000", 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.017875773000000001 2024-09-16T04:09:13.611 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:938 3.4s0 3:20adce66:::smithi20431790-50:18 [read 0~3653632,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.667714+0000", 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.833918337, 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.037152507000000001, 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.612 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 938 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.667714+0000", 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.613 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.667714+0000", 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.667715+0000", 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.59e-06 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.667724+0000", 2024-09-16T04:09:13.614 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.3340000000000002e-06 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.667744+0000", 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9928999999999998e-05 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.667759+0000", 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5576000000000001e-05 2024-09-16T04:09:13.615 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.686800+0000", 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019040972 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.687274+0000", 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00047351099999999997 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.616 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.704866+0000", 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.017592594999999999 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:939 3.4s0 3:20adce66:::smithi20431790-50:18 [read 0~3653632,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.668016+0000", 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 10.833616495999999, 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.040977228999999997, 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:13.617 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 939 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.668016+0000", 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.618 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.668016+0000", 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.668017+0000", 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7099999999999999e-06 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.668028+0000", 2024-09-16T04:09:13.619 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.0413e-05 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.668052+0000", 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4236e-05 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.668070+0000", 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.836e-05 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.688182+0000", 2024-09-16T04:09:13.620 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.020111779999999999 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.688847+0000", 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00066460100000000002 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.708993+0000", 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.020146128999999999 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:13.621 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:13.623 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-16T04:09:13.751 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:13.751 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:13.751 INFO:teuthology.orchestra.run.smithi196.stdout: "num_ops": 0 2024-09-16T04:09:13.751 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:13.765 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-16T04:09:13.888 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:13.888 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [], 2024-09-16T04:09:13.888 INFO:teuthology.orchestra.run.smithi196.stdout: "complaint_time": 30, 2024-09-16T04:09:13.888 INFO:teuthology.orchestra.run.smithi196.stdout: "num_blocked_ops": 0 2024-09-16T04:09:13.888 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:13.903 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-16T04:09:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-16T04:09:14.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-16T04:09:14.028 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "size": 20, 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 600, 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "ops": [ 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=2, reqid=client.4631.0:2, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 57.083328764999997, 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013450198999999999, 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.029 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942096+0000", 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942097+0000", 2024-09-16T04:09:14.030 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.2600000000000001e-07 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942125+0000", 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8059e-05 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942143+0000", 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8116000000000001e-05 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.031 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.942165+0000", 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1959000000000001e-05 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943008+0000", 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00084321400000000001 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.943028+0000", 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0132999999999998e-05 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.032 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955472+0000", 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012443511000000001 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.955546+0000", 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.4281000000000003e-05 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.033 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 33/31 ECSubWrite(tid=3, reqid=client.4631.0:22, at_version=33'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 57.078820133000001, 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01145176, 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.034 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946604+0000", 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946606+0000", 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5939999999999999e-06 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.035 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.946710+0000", 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010391399999999999 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948852+0000", 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0021415980000000002 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948878+0000", 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.597e-05 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.036 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.948998+0000", 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000120791 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.949037+0000", 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.8680000000000002e-05 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.957977+0000", 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089400739999999992 2024-09-16T04:09:14.037 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:16.958056+0000", 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.9139000000000002e-05 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:421 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 37.930558544, 2024-09-16T04:09:14.038 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.013252471, 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 421 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.039 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094866+0000", 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094867+0000", 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.1999999999999998e-07 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094872+0000", 2024-09-16T04:09:14.040 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.9590000000000003e-06 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094883+0000", 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1616e-05 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.094895+0000", 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.1226999999999999e-05 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.041 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.103881+0000", 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089864100000000002 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.104033+0000", 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000152342 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:36.108118+0000", 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0040850970000000002 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.042 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.9s2 54/31 ECSubWrite(tid=70, reqid=osd.12.0:69, at_version=0'0, trim_to=0'0, roll_forward_to=54'25))", 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 36.955045759999997, 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098073039999999993, 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.043 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070379+0000", 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070381+0000", 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0999999999999998e-06 2024-09-16T04:09:14.044 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070410+0000", 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.8619000000000002e-05 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070469+0000", 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.9508e-05 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.045 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070492+0000", 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3373000000000001e-05 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070735+0000", 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00024256899999999999 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.070760+0000", 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4825999999999999e-05 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.046 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080100+0000", 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093401479999999995 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:37.080186+0000", 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6161000000000004e-05 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.047 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/31 ECSubWrite(tid=212, reqid=osd.10.0:212, at_version=60'106, trim_to=0'0, roll_forward_to=57'102))", 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.877995+0000", 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.147429086999999, 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010951160999999999, 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.877995+0000", 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.048 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.877995+0000", 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.877997+0000", 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9939999999999999e-06 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.049 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878050+0000", 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.2037999999999999e-05 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878087+0000", 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.7595999999999997e-05 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878110+0000", 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3289e-05 2024-09-16T04:09:14.050 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878280+0000", 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016937899999999999 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.878312+0000", 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2005000000000003e-05 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888841+0000", 2024-09-16T04:09:14.051 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.01052931 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888947+0000", 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010555 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 60/31 ECSubWrite(tid=213, reqid=osd.10.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=60'66))", 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:42.879639+0000", 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 31.145785072999999, 2024-09-16T04:09:14.052 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.009419574, 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879639+0000", 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.053 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879639+0000", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879642+0000", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.057e-06 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879674+0000", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2202000000000001e-05 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879706+0000", 2024-09-16T04:09:14.054 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2202000000000001e-05 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879730+0000", 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3753000000000001e-05 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879883+0000", 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000152979 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.879908+0000", 2024-09-16T04:09:14.055 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5686000000000001e-05 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.888977+0000", 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090684370000000004 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:42.889059+0000", 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.2257999999999997e-05 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.056 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 64/31 ECSubWrite(tid=269, reqid=osd.10.0:269, at_version=64'142, trim_to=0'0, roll_forward_to=63'138))", 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908152+0000", 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.117272514, 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011063590999999999, 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.057 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908152+0000", 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908152+0000", 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908154+0000", 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5799999999999999e-06 2024-09-16T04:09:14.058 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908203+0000", 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.9786000000000001e-05 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908237+0000", 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3422e-05 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908307+0000", 2024-09-16T04:09:14.059 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.0325000000000002e-05 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909572+0000", 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001264488 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909620+0000", 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.8655000000000001e-05 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.060 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918931+0000", 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093103189999999992 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.919216+0000", 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028501600000000002 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.061 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:539 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908765+0000", 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.116659496, 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.015950052999999999, 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 539 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.062 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908765+0000", 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908765+0000", 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908768+0000", 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.0960000000000001e-06 2024-09-16T04:09:14.063 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908783+0000", 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.525e-05 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908818+0000", 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.4476e-05 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.064 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908840+0000", 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2226e-05 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909124+0000", 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00028427599999999997 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "op must wait for map", 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909137+0000", 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2442999999999999e-05 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.065 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914009+0000", 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0048725189999999996 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914283+0000", 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00027343000000000002 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.066 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.924715+0000", 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010432337 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:540 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908904+0000", 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.116520479999998, 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.018391718000000001, 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.067 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 540 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908904+0000", 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.068 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908904+0000", 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908906+0000", 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6339999999999999e-06 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.069 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908916+0000", 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9699999999999994e-06 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908939+0000", 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3811999999999998e-05 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908957+0000", 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7235999999999999e-05 2024-09-16T04:09:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909388+0000", 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00043154599999999999 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909415+0000", 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7109000000000001e-05 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.920093+0000", 2024-09-16T04:09:14.071 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010677130999999999 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.920258+0000", 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00016524199999999999 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.927296+0000", 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070380379999999999 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.072 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:541 3.6s0 3:6983244e:::smithi20431790-35:head [read 0~1114112,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.908982+0000", 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.116442127999999, 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.026058347999999999, 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 541 2024-09-16T04:09:14.073 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908982+0000", 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908982+0000", 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.074 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908984+0000", 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3859999999999999e-06 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.908994+0000", 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.8339999999999994e-06 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909013+0000", 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9205e-05 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.075 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909026+0000", 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.2984e-05 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909515+0000", 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00048913699999999995 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:14.076 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.909533+0000", 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7863000000000002e-05 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.928869+0000", 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.019336559999999999 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.929225+0000", 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00035511100000000002 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.077 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.935041+0000", 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0058162680000000003 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 64/31 ECSubWrite(tid=284, reqid=osd.11.0:284, at_version=64'30, trim_to=0'0, roll_forward_to=63'28))", 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.110549628000001, 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0097099319999999992, 2024-09-16T04:09:14.078 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.079 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914875+0000", 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.6300000000000005e-07 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914947+0000", 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.1338e-05 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.080 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914969+0000", 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2036e-05 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.914994+0000", 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5343000000000001e-05 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.915143+0000", 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014897900000000001 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.081 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.915232+0000", 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8914999999999998e-05 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.924478+0000", 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0092462369999999992 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.924585+0000", 2024-09-16T04:09:14.082 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00010652100000000001 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.4s2 64/31 ECSubWrite(tid=270, reqid=osd.10.0:270, at_version=64'86, trim_to=0'0, roll_forward_to=63'84))", 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.918576+0000", 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.106848407000001, 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012891098, 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.083 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918576+0000", 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918576+0000", 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918578+0000", 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8500000000000001e-06 2024-09-16T04:09:14.084 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918654+0000", 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.5581999999999996e-05 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918683+0000", 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.9232999999999999e-05 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918705+0000", 2024-09-16T04:09:14.085 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2376000000000001e-05 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918862+0000", 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015726600000000001 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.918888+0000", 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5919e-05 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.086 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931379+0000", 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012490535000000001 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931467+0000", 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.8337000000000005e-05 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 64/31 ECSubWrite(tid=271, reqid=osd.10.0:269, at_version=0'0, trim_to=0'0, roll_forward_to=64'142))", 2024-09-16T04:09:14.087 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:46.921950+0000", 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 27.103474298999998, 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0097019189999999998, 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921950+0000", 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.088 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921950+0000", 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921952+0000", 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.973e-06 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.921980+0000", 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.7719e-05 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.089 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922369+0000", 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00038864699999999999 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922391+0000", 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2765999999999999e-05 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922542+0000", 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00015051299999999999 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.090 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.922568+0000", 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.5698999999999999e-05 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931572+0000", 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0090044779999999998 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:46.931652+0000", 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.0123999999999994e-05 2024-09-16T04:09:14.091 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 74/69 ECSubWrite(tid=358, reqid=osd.10.0:358, at_version=74'41, trim_to=0'0, roll_forward_to=70'39))", 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 17.161149053999999, 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010815933999999999, 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.092 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864276+0000", 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.6299999999999993e-07 2024-09-16T04:09:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864345+0000", 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.8552000000000004e-05 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864377+0000", 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.2193000000000002e-05 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.864399+0000", 2024-09-16T04:09:14.094 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1766000000000001e-05 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.865105+0000", 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00070608499999999996 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.865130+0000", 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4669999999999999e-05 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.095 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.875033+0000", 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.009903607 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:08:56.875091+0000", 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.8097999999999998e-05 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.8s4 79/69 ECSubWrite(tid=407, reqid=osd.10.0:407, at_version=79'47, trim_to=0'0, roll_forward_to=78'45))", 2024-09-16T04:09:14.096 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.894184+0000", 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 12.131240472, 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010785253, 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894184+0000", 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.097 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894184+0000", 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894185+0000", 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.2300000000000001e-07 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894252+0000", 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.6859000000000005e-05 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.098 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894285+0000", 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3636000000000001e-05 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894310+0000", 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.4859e-05 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894461+0000", 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000150681 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.099 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.894486+0000", 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.482e-05 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.904841+0000", 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.010355573 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.904969+0000", 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000128202 2024-09-16T04:09:14.100 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 79/31 ECSubWrite(tid=408, reqid=osd.10.0:408, at_version=79'183, trim_to=0'0, roll_forward_to=77'181))", 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.895290+0000", 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 12.130134664, 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012314238999999999, 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.101 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895290+0000", 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895290+0000", 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895292+0000", 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7799999999999999e-06 2024-09-16T04:09:14.102 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895346+0000", 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.4469000000000003e-05 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895379+0000", 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3173000000000002e-05 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895401+0000", 2024-09-16T04:09:14.103 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1858999999999999e-05 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895614+0000", 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00021273599999999999 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.895636+0000", 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1725999999999998e-05 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.104 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.907517+0000", 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011881832 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.907604+0000", 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.6663999999999996e-05 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.5s2 79/31 ECSubWrite(tid=165, reqid=osd.5.0:165, at_version=79'40, trim_to=0'0, roll_forward_to=78'36))", 2024-09-16T04:09:14.105 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.901826+0000", 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 12.123598765000001, 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011550843999999999, 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.901826+0000", 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.106 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.901826+0000", 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.901827+0000", 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3969999999999999e-06 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.901877+0000", 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 4.9704999999999999e-05 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.107 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.901900+0000", 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3592999999999999e-05 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.901920+0000", 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.9279999999999998e-05 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.903899+0000", 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0019790020000000001 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.108 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.903914+0000", 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.5276000000000001e-05 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.913298+0000", 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093841229999999994 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.913377+0000", 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 7.8467999999999995e-05 2024-09-16T04:09:14.109 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "MOSDECSubOpWrite(3.bs6 79/31 ECSubWrite(tid=409, reqid=osd.10.0:409, at_version=79'185, trim_to=0'0, roll_forward_to=77'181))", 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:01.902206+0000", 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 12.123218946, 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.011067857, 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.110 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.902206+0000", 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.902206+0000", 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.902208+0000", 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.0700000000000001e-06 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.111 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.902263+0000", 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 5.5442999999999998e-05 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.902297+0000", 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 3.3921999999999998e-05 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.112 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.902321+0000", 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.3553e-05 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.904242+0000", 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.001921629 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.904265+0000", 2024-09-16T04:09:14.113 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.2759999999999999e-05 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.913184+0000", 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0089185989999999993 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:01.913273+0000", 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 8.9881000000000002e-05 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.114 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:836 3.7s0 3:e9187311:::smithi20431790-39:head [append 0~0] snapc 18=[18] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.056580+0000", 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.968844271, 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.012965859999999999, 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:14.115 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 836 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.056580+0000", 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.116 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.056580+0000", 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.056582+0000", 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.3069999999999999e-06 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.056588+0000", 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 6.4699999999999999e-06 2024-09-16T04:09:14.117 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.056607+0000", 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.8972999999999999e-05 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.056622+0000", 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.4616e-05 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.065991+0000", 2024-09-16T04:09:14.118 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0093692800000000007 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.066155+0000", 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.000164017 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.067282+0000", 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0011274379999999999 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.119 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.068712+0000", 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0014292389999999999 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "commit_sent", 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.069397+0000", 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00068582300000000001 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.120 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.069546+0000", 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00014869699999999999 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "description": "osd_op(client.4631.0:870 3.7s0 3:e9187311:::smithi20431790-39:18 [read 0~638976,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "initiated_at": "2024-09-16T04:09:02.208515+0000", 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "age": 11.816909298000001, 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0098094480000000001, 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "continuous": false, 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "type_data": { 2024-09-16T04:09:14.121 INFO:teuthology.orchestra.run.smithi196.stdout: "flag_point": "started", 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "client_info": { 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "client": "client.4631", 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "tid": 870 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "events": [ 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "initiated", 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208515+0000", 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "header_read", 2024-09-16T04:09:14.122 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208515+0000", 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "throttled", 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208517+0000", 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.6500000000000001e-06 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "all_read", 2024-09-16T04:09:14.123 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208527+0000", 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 9.9729999999999992e-06 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "dispatched", 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208548+0000", 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 2.1180000000000001e-05 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.208566+0000", 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 1.7966e-05 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.124 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "reached_pg", 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.210921+0000", 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0023552930000000001 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "started", 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.211252+0000", 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.00033115800000000002 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: { 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "event": "done", 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "time": "2024-09-16T04:09:02.218325+0000", 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: "duration": 0.0070722279999999998 2024-09-16T04:09:14.125 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.126 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.126 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.126 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-09-16T04:09:14.126 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-09-16T04:09:14.126 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-09-16T04:09:14.127 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T04:09:14.260 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:14.261 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:14.261 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:09:14.261 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:14.275 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-16T04:09:14.393 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:14.393 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:14.394 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:14.394 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:14.394 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:14.408 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 43.674328045000003, 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0070627650000000004, 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.530 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851453+0000", 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851455+0000", 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.206e-06 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851524+0000", 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8961999999999995e-05 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851547+0000", 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3893e-05 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.532 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851567+0000", 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9102000000000001e-05 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852770+0000", 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001203815 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852794+0000", 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3527e-05 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.533 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858409+0000", 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056155329999999998 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858516+0000", 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000106727 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.534 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 43.673231377999997, 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064106290000000002, 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.535 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852550+0000", 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852551+0000", 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6700000000000003e-07 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852640+0000", 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9158000000000003e-05 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.536 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852673+0000", 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2775999999999999e-05 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852698+0000", 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5661999999999999e-05 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852915+0000", 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000216281 2024-09-16T04:09:14.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853049+0000", 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013407299999999999 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858910+0000", 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005861163 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858961+0000", 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0949000000000003e-05 2024-09-16T04:09:14.538 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=148, reqid=osd.10.0:147, at_version=0'0, trim_to=0'0, roll_forward_to=48'46))", 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 43.654408684000003, 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0071558660000000003, 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.539 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871373+0000", 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871375+0000", 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2929999999999999e-06 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871406+0000", 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1232999999999997e-05 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871444+0000", 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7688999999999998e-05 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871469+0000", 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4936e-05 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.541 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871646+0000", 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017657299999999999 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.871673+0000", 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7044999999999999e-05 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878426+0000", 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067531659999999997 2024-09-16T04:09:14.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.878529+0000", 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010293099999999999 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 43.653339420999998, 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0087467719999999999, 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.543 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872442+0000", 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.544 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872444+0000", 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4490000000000002e-06 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872725+0000", 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00028078400000000001 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872755+0000", 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9329999999999999e-05 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.545 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872775+0000", 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0750999999999998e-05 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872977+0000", 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020181499999999999 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873000+0000", 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3254000000000001e-05 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881108+0000", 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0081072399999999999 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881189+0000", 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1149000000000005e-05 2024-09-16T04:09:14.547 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 48/31 ECSubWrite(tid=150, reqid=osd.10.0:150, at_version=48'48, trim_to=0'0, roll_forward_to=48'46))", 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 43.650718718999997, 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0059911859999999999, 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.548 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.549 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.549 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.549 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.549 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875063+0000", 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875065+0000", 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1399999999999998e-06 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.550 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875118+0000", 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3582000000000003e-05 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875151+0000", 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2311999999999998e-05 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875174+0000", 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.283e-05 2024-09-16T04:09:14.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875376+0000", 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020205700000000001 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.875407+0000", 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1792999999999999e-05 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880960+0000", 2024-09-16T04:09:14.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055526580000000002 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.881054+0000", 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3814000000000007e-05 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 53/31 ECSubWrite(tid=244, reqid=client.4631.0:408, at_version=53'50, trim_to=0'0, roll_forward_to=52'48))", 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 38.643106684999999, 2024-09-16T04:09:14.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0058951469999999999, 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882675+0000", 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.554 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.882676+0000", 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.093e-06 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883042+0000", 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00036582100000000001 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883079+0000", 2024-09-16T04:09:14.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7622e-05 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883112+0000", 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2685999999999998e-05 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883631+0000", 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00051925400000000003 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.556 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.883755+0000", 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000124003 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.888484+0000", 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0047283309999999997 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.888570+0000", 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6336999999999997e-05 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 53/31 ECSubWrite(tid=179, reqid=client.4631.0:427, at_version=53'57, trim_to=0'0, roll_forward_to=52'55))", 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 38.367641202000001, 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060365560000000002, 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158140+0000", 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158141+0000", 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5600000000000001e-07 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158605+0000", 2024-09-16T04:09:14.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046468300000000002 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158631+0000", 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.544e-05 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158655+0000", 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3699000000000001e-05 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158836+0000", 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018186299999999999 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.158868+0000", 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1809e-05 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.164050+0000", 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051816689999999999 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:36.164177+0000", 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012693700000000001 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 37.458232471000002, 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053899769999999998, 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.562 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067549+0000", 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067550+0000", 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7999999999999995e-07 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067604+0000", 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4209000000000002e-05 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067647+0000", 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2871999999999999e-05 2024-09-16T04:09:14.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067671+0000", 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4283000000000001e-05 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.068006+0000", 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033519600000000001 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.068032+0000", 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5303000000000002e-05 2024-09-16T04:09:14.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072844+0000", 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048127869999999998 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072939+0000", 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4647000000000004e-05 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 54/31 ECSubWrite(tid=186, reqid=osd.10.0:186, at_version=54'62, trim_to=0'0, roll_forward_to=53'60))", 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 37.447914615000002, 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0057063770000000003, 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077867+0000", 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.04e-07 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077893+0000", 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6029000000000001e-05 2024-09-16T04:09:14.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077913+0000", 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9653999999999999e-05 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.077941+0000", 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8561999999999999e-05 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.078109+0000", 2024-09-16T04:09:14.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016742100000000001 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.078136+0000", 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.711e-05 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.083476+0000", 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053401189999999999 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.083573+0000", 2024-09-16T04:09:14.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7277999999999999e-05 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 63/31 ECSubWrite(tid=243, reqid=client.4631.0:503, at_version=63'76, trim_to=0'0, roll_forward_to=62'74))", 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:45.899954+0000", 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 28.625827154, 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0059593249999999997, 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.571 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.899954+0000", 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.899954+0000", 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.899955+0000", 2024-09-16T04:09:14.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4000000000000001e-07 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900014+0000", 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.9412e-05 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900044+0000", 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0125999999999999e-05 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.573 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900075+0000", 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0346999999999999e-05 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900248+0000", 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000173449 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.900276+0000", 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7267000000000002e-05 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.905816+0000", 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055403659999999997 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:45.905914+0000", 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7718000000000002e-05 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 64/31 ECSubWrite(tid=290, reqid=client.4631.0:558, at_version=64'67, trim_to=0'0, roll_forward_to=64'66))", 2024-09-16T04:09:14.575 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:47.019271+0000", 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.506510538000001, 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.007474957, 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019271+0000", 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019271+0000", 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019274+0000", 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8700000000000001e-06 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019325+0000", 2024-09-16T04:09:14.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1409000000000002e-05 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019373+0000", 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7883000000000002e-05 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019399+0000", 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5469999999999998e-05 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019803+0000", 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00040412199999999998 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.019831+0000", 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8276000000000002e-05 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.026666+0000", 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068353219999999996 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.026746+0000", 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9604999999999994e-05 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 73/31 ECSubWrite(tid=91, reqid=client.4631.0:694, at_version=73'40, trim_to=0'0, roll_forward_to=73'38))", 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.068312+0000", 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.457469393, 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0054766650000000004, 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.580 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068312+0000", 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068312+0000", 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068313+0000", 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.012e-06 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068513+0000", 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019977999999999999 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068554+0000", 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0812999999999997e-05 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068586+0000", 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2563e-05 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068778+0000", 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000192213 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.068819+0000", 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0349000000000003e-05 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.073694+0000", 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004875117 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.585 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.073789+0000", 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4817999999999999e-05 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 73/31 ECSubWrite(tid=92, reqid=client.4631.0:695, at_version=73'41, trim_to=0'0, roll_forward_to=73'38))", 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.069858+0000", 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.455923238, 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093874839999999998, 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.586 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069858+0000", 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069858+0000", 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069860+0000", 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.372e-06 2024-09-16T04:09:14.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069947+0000", 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7717000000000001e-05 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069966+0000", 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9080999999999999e-05 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.069979+0000", 2024-09-16T04:09:14.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2539e-05 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.070099+0000", 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000119836 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.070122+0000", 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3105999999999999e-05 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.079160+0000", 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.009038305 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.079246+0000", 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5527999999999998e-05 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 73/31 ECSubWrite(tid=93, reqid=client.4631.0:696, at_version=73'42, trim_to=0'0, roll_forward_to=73'39))", 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.071521+0000", 2024-09-16T04:09:14.590 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.454259995000001, 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0096354549999999994, 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071521+0000", 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071521+0000", 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071523+0000", 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.099e-06 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071545+0000", 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2583999999999999e-05 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071562+0000", 2024-09-16T04:09:14.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7136e-05 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071572+0000", 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2289999999999992e-06 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071666+0000", 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4326000000000005e-05 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.071683+0000", 2024-09-16T04:09:14.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7275999999999999e-05 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.079254+0000", 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.007570495 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.081157+0000", 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019033100000000001 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.594 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 73/31 ECSubWrite(tid=307, reqid=client.4631.0:718, at_version=73'75, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.172216+0000", 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.353565408000001, 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.008843254, 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172216+0000", 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.595 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172216+0000", 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172219+0000", 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5129999999999999e-06 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172276+0000", 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.7283e-05 2024-09-16T04:09:14.596 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172326+0000", 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0565999999999997e-05 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172351+0000", 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4975999999999999e-05 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172553+0000", 2024-09-16T04:09:14.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020191999999999999 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172580+0000", 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6466999999999999e-05 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180980+0000", 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0083997399999999993 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181059+0000", 2024-09-16T04:09:14.598 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9789000000000005e-05 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 73/31 ECSubWrite(tid=308, reqid=client.4631.0:719, at_version=73'76, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176323+0000", 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.349458242000001, 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0066864940000000003, 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.599 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176323+0000", 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176323+0000", 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176326+0000", 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7499999999999999e-06 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176378+0000", 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.1928999999999997e-05 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176415+0000", 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.7106e-05 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176440+0000", 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4649999999999999e-05 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176592+0000", 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015200700000000001 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176616+0000", 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4700000000000001e-05 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.182911+0000", 2024-09-16T04:09:14.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0062944869999999997 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.183010+0000", 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8864999999999996e-05 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s5 73/31 ECSubWrite(tid=309, reqid=client.4631.0:720, at_version=73'77, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176739+0000", 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.349042206, 2024-09-16T04:09:14.603 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0070976980000000004, 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176739+0000", 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176739+0000", 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176742+0000", 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3700000000000002e-06 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176917+0000", 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017562099999999999 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176954+0000", 2024-09-16T04:09:14.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6709999999999999e-05 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176980+0000", 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6132e-05 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180598+0000", 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0036179099999999998 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180621+0000", 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3393000000000001e-05 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.183766+0000", 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031449210000000002 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.183837+0000", 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.0641000000000003e-05 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.607 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 74/31 ECSubWrite(tid=105, reqid=osd.12.0:105, at_version=74'45, trim_to=0'0, roll_forward_to=73'43))", 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 17.661321802, 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061017770000000001, 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864460+0000", 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7999999999999995e-07 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864519+0000", 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.9154999999999999e-05 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864552+0000", 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2977e-05 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864578+0000", 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5395999999999999e-05 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.610 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864755+0000", 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017691699999999999 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864781+0000", 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5836000000000001e-05 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.870475+0000", 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056942269999999996 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.611 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.870561+0000", 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6588999999999994e-05 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.0s3 79/31 ECSubWrite(tid=113, reqid=client.4631.0:831, at_version=79'53, trim_to=0'0, roll_forward_to=77'51))", 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.901881+0000", 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 12.623900127000001, 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.006217322, 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.612 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901881+0000", 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901881+0000", 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901882+0000", 2024-09-16T04:09:14.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8999999999999996e-07 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901939+0000", 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6932000000000003e-05 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901976+0000", 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6789999999999998e-05 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.902002+0000", 2024-09-16T04:09:14.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6662999999999999e-05 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.902158+0000", 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000155451 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.902185+0000", 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7123000000000001e-05 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.615 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.908002+0000", 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005817511 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.908099+0000", 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6162000000000005e-05 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s3 79/31 ECSubWrite(tid=453, reqid=client.4631.0:931, at_version=79'151, trim_to=0'0, roll_forward_to=79'149))", 2024-09-16T04:09:14.616 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:02.667052+0000", 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 11.858729019, 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060260679999999999, 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.667052+0000", 2024-09-16T04:09:14.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.667052+0000", 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.667053+0000", 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3399999999999997e-07 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:14.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.667102+0000", 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8662000000000003e-05 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.667122+0000", 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0242999999999999e-05 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.667132+0000", 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9189999999999994e-06 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:14.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.670068+0000", 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002936031 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.670081+0000", 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3227000000000001e-05 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.673025+0000", 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029435749999999999 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:14.620 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.673079+0000", 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3477000000000003e-05 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:14.621 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:14.622 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-16T04:09:14.750 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:14.750 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:14.750 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:09:14.750 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:14.765 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-16T04:09:14.881 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:14.881 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:14.881 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:14.881 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:14.881 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:14.895 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-16T04:09:15.010 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.8 to 1 (10000) 2024-09-16T04:09:15.018 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:15.018 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:15.018 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:15.018 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:15.018 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 34/31 ECSubWrite(tid=162, reqid=client.4631.0:37, at_version=34'3, trim_to=0'0, roll_forward_to=0'0))", 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.066061414000004, 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005624703, 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:15.019 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948718+0000", 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7399999999999999e-07 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.020 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948775+0000", 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6127e-05 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948794+0000", 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9264000000000001e-05 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.948804+0000", 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7499999999999998e-06 2024-09-16T04:09:15.021 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949606+0000", 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080285899999999995 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.949616+0000", 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6900000000000004e-06 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.022 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954283+0000", 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046664230000000003 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954343+0000", 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0316000000000003e-05 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 43/31 ECSubWrite(tid=203, reqid=client.4631.0:283, at_version=43'21, trim_to=0'0, roll_forward_to=42'19))", 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:15.023 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.982028585999998, 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049720880000000004, 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.024 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032751+0000", 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3900000000000001e-07 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032842+0000", 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0807e-05 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.025 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032862+0000", 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9660000000000002e-05 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032872+0000", 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0726e-05 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032974+0000", 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101142 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.026 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.032984+0000", 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0713000000000001e-05 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037679+0000", 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046946610000000001 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.037723+0000", 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4140000000000001e-05 2024-09-16T04:09:15.027 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=225, reqid=osd.11.0:225, at_version=48'38, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.163317067999998, 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055937950000000004, 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.028 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851463+0000", 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.0999999999999999e-07 2024-09-16T04:09:15.029 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851488+0000", 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4587e-05 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851502+0000", 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4797000000000001e-05 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.851514+0000", 2024-09-16T04:09:15.030 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1073000000000001e-05 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853720+0000", 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00220616 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853745+0000", 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5653e-05 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.031 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857009+0000", 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003263775 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857056+0000", 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7240000000000002e-05 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=81, reqid=osd.13.0:81, at_version=48'19, trim_to=0'0, roll_forward_to=47'17))", 2024-09-16T04:09:15.032 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.162659148000003, 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051176499999999996, 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.033 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852120+0000", 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852121+0000", 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7599999999999996e-07 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852170+0000", 2024-09-16T04:09:15.034 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9035000000000001e-05 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852191+0000", 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0472999999999999e-05 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852205+0000", 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4048e-05 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.035 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852390+0000", 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018541099999999999 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852418+0000", 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7985999999999999e-05 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857089+0000", 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046703320000000001 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.036 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857238+0000", 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014958899999999999 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 48/31 ECSubWrite(tid=80, reqid=osd.13.0:80, at_version=48'30, trim_to=0'0, roll_forward_to=46'28))", 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.162527673, 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050972430000000004, 2024-09-16T04:09:15.037 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852252+0000", 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.038 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852253+0000", 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1099999999999995e-07 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852285+0000", 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1846e-05 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852299+0000", 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4659e-05 2024-09-16T04:09:15.039 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.852310+0000", 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1287999999999999e-05 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853693+0000", 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001382826 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.040 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.853719+0000", 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6016e-05 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857307+0000", 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003587369 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857349+0000", 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.2527999999999997e-05 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.041 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=226, reqid=client.4631.0:375, at_version=48'39, trim_to=0'0, roll_forward_to=44'34))", 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.152500642, 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0050701030000000003, 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.042 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862279+0000", 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862280+0000", 2024-09-16T04:09:15.043 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2389999999999999e-06 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862380+0000", 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9331000000000002e-05 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862396+0000", 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6789000000000001e-05 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.044 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862409+0000", 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2384e-05 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862627+0000", 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021813 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.862652+0000", 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5519000000000001e-05 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.045 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867248+0000", 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0045958509999999998 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867349+0000", 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010086000000000001 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.046 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 48/31 ECSubWrite(tid=227, reqid=client.4631.0:376, at_version=48'40, trim_to=0'0, roll_forward_to=48'36))", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.142137497, 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0069465819999999998, 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872642+0000", 2024-09-16T04:09:15.047 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872645+0000", 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.384e-06 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872912+0000", 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00026752299999999998 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.048 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872958+0000", 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5624999999999998e-05 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.872982+0000", 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4443e-05 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873128+0000", 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014554100000000001 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.049 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.873152+0000", 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4428000000000001e-05 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879494+0000", 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0063421629999999996 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.879589+0000", 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4475000000000006e-05 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.050 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=246, reqid=client.4631.0:409, at_version=53'51, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 39.121501408999997, 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0085214520000000005, 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.051 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893278+0000", 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893281+0000", 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4099999999999998e-06 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893613+0000", 2024-09-16T04:09:15.052 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00033196199999999999 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893658+0000", 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5498999999999999e-05 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893682+0000", 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4159e-05 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.053 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893893+0000", 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000210845 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.893920+0000", 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6931999999999999e-05 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901667+0000", 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0077466979999999998 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.054 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901800+0000", 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013294700000000001 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 53/31 ECSubWrite(tid=247, reqid=client.4631.0:410, at_version=53'52, trim_to=0'0, roll_forward_to=53'50))", 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 39.117846192999998, 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.004935488, 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.055 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896933+0000", 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.056 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.896935+0000", 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8959999999999999e-06 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897016+0000", 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0438000000000005e-05 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897061+0000", 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4988999999999999e-05 2024-09-16T04:09:15.057 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897084+0000", 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3139999999999999e-05 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897310+0000", 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000226424 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.897334+0000", 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4083e-05 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.058 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901810+0000", 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0044760260000000001 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:35.901869+0000", 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8492000000000002e-05 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.059 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 54/31 ECSubWrite(tid=255, reqid=osd.11.0:255, at_version=54'55, trim_to=0'0, roll_forward_to=53'53))", 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 37.947288467999996, 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053273050000000001, 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.060 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067491+0000", 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067492+0000", 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0299999999999998e-07 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067551+0000", 2024-09-16T04:09:15.061 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8916000000000003e-05 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067582+0000", 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1472e-05 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067606+0000", 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3485999999999998e-05 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.062 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067731+0000", 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000125365 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.067741+0000", 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9890000000000004e-06 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072715+0000", 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049738159999999998 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.063 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:37.072818+0000", 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103458 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=307, reqid=client.4631.0:718, at_version=73'75, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.842665181000001, 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060468179999999998, 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.064 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172114+0000", 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172117+0000", 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1330000000000002e-06 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172170+0000", 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3256e-05 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172211+0000", 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1554999999999998e-05 2024-09-16T04:09:15.066 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172236+0000", 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4980000000000001e-05 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172713+0000", 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00047679299999999999 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.067 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.172743+0000", 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0229000000000001e-05 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.178058+0000", 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0053146169999999998 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.178161+0000", 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000103255 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.068 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=308, reqid=client.4631.0:719, at_version=73'76, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.839932527999999, 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.005380162, 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.069 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174847+0000", 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174850+0000", 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8100000000000002e-06 2024-09-16T04:09:15.070 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174903+0000", 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2908999999999998e-05 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174935+0000", 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.2660000000000002e-05 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.174956+0000", 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0109e-05 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.071 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.175187+0000", 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00023095 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.175210+0000", 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3736000000000001e-05 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180131+0000", 2024-09-16T04:09:15.072 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049211790000000004 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.180227+0000", 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5809000000000004e-05 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 73/31 ECSubWrite(tid=309, reqid=client.4631.0:720, at_version=73'77, trim_to=0'0, roll_forward_to=73'73))", 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.837986162, 2024-09-16T04:09:15.073 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048893319999999997, 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176793+0000", 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.074 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176795+0000", 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9230000000000001e-06 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176840+0000", 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.4722999999999999e-05 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.075 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176874+0000", 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3835999999999999e-05 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.176897+0000", 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2799999999999999e-05 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.177457+0000", 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00056058499999999995 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.076 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.177481+0000", 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4006e-05 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181605+0000", 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0041238280000000004 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.077 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.181683+0000", 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7631000000000003e-05 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 74/31 ECSubWrite(tid=187, reqid=client.4631.0:758, at_version=74'47, trim_to=0'0, roll_forward_to=74'45))", 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 17.989256820000001, 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0061683500000000004, 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.078 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025523+0000", 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.079 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.025524+0000", 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.587e-06 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026540+0000", 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001015324 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026570+0000", 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0642999999999998e-05 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.080 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026586+0000", 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6118999999999999e-05 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026721+0000", 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013497499999999999 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.026737+0000", 2024-09-16T04:09:15.081 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5763000000000001e-05 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.031644+0000", 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049069880000000001 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.031691+0000", 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6950999999999998e-05 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.082 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 79/31 ECSubWrite(tid=208, reqid=osd.13.0:208, at_version=79'71, trim_to=0'0, roll_forward_to=78'67))", 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.887781+0000", 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 13.126999069, 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012267587, 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887781+0000", 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.083 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887781+0000", 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887782+0000", 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0300000000000001e-06 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887836+0000", 2024-09-16T04:09:15.084 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4196000000000001e-05 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887863+0000", 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7670000000000001e-05 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.887886+0000", 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2651999999999999e-05 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.888128+0000", 2024-09-16T04:09:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024174999999999999 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.888152+0000", 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3842999999999999e-05 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.899954+0000", 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011802211 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.900048+0000", 2024-09-16T04:09:15.086 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4234999999999995e-05 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.2s6 79/31 ECSubWrite(tid=343, reqid=osd.11.0:343, at_version=79'108, trim_to=0'0, roll_forward_to=78'106))", 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.892886+0000", 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 13.121893127, 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0073524920000000004, 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892886+0000", 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892886+0000", 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892887+0000", 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9299999999999997e-07 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.088 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892941+0000", 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3742000000000001e-05 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892972+0000", 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1084000000000003e-05 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.892994+0000", 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1713e-05 2024-09-16T04:09:15.089 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.893155+0000", 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016086400000000001 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.893179+0000", 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4723e-05 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.090 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.900057+0000", 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068773219999999999 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.900239+0000", 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000182351 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 79/31 ECSubWrite(tid=210, reqid=osd.13.0:208, at_version=0'0, trim_to=0'0, roll_forward_to=79'71))", 2024-09-16T04:09:15.091 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.901794+0000", 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 13.112985788, 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049036180000000002, 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901794+0000", 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.092 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901794+0000", 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901796+0000", 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.17e-06 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901882+0000", 2024-09-16T04:09:15.093 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5572e-05 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901928+0000", 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.6776000000000001e-05 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.901956+0000", 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7492999999999999e-05 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.094 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904657+0000", 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.002700727 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904681+0000", 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4003e-05 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.906608+0000", 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019274990000000001 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.095 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.906697+0000", 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.9377999999999997e-05 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.fs4 79/31 ECSubWrite(tid=211, reqid=osd.13.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=79'63))", 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:01.904235+0000", 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 13.110544787, 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0086257030000000002, 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.096 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904235+0000", 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904235+0000", 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.097 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904236+0000", 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.66e-06 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904260+0000", 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3445999999999999e-05 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904299+0000", 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.9249999999999999e-05 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.098 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904328+0000", 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8883000000000001e-05 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904854+0000", 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00052583199999999995 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.904877+0000", 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2866000000000001e-05 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.099 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.912775+0000", 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0078980709999999996 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:01.912861+0000", 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5694999999999999e-05 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.100 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.1s6 79/31 ECSubWrite(tid=23, reqid=client.4631.0:863, at_version=79'13, trim_to=0'0, roll_forward_to=66'11))", 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:02.205296+0000", 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 12.809483674999999, 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060453080000000001, 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205296+0000", 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.101 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205296+0000", 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205298+0000", 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.61e-06 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205477+0000", 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017918799999999999 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.102 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205503+0000", 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6625999999999999e-05 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205520+0000", 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6963e-05 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205704+0000", 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000183974 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.205731+0000", 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6838999999999998e-05 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.211258+0000", 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0055268929999999997 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.211341+0000", 2024-09-16T04:09:15.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3214999999999995e-05 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.as2 79/31 ECSubWrite(tid=230, reqid=client.4631.0:930, at_version=0'0, trim_to=0'0, roll_forward_to=79'79))", 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:09:02.666156+0000", 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 12.348623250999999, 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0051125490000000001, 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:15.105 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666156+0000", 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666156+0000", 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666157+0000", 2024-09-16T04:09:15.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4e-07 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666169+0000", 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1701e-05 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666183+0000", 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4178e-05 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.107 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666207+0000", 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4114999999999999e-05 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666276+0000", 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8547000000000006e-05 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.666285+0000", 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5440000000000004e-06 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.671213+0000", 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0049274890000000002 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:09:02.671269+0000", 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.6134999999999997e-05 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.109 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:15.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-09-16T04:09:15.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-16T04:09:15.239 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:15.239 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:15.240 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:09:15.240 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:15.253 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-16T04:09:15.377 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:15.377 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:15.377 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:15.377 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:15.377 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:15.391 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-16T04:09:15.511 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4347.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 73.826007044999997, 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.078945607000000001, 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.512 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4347", 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.32:0/2031529803", 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.513 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680772+0000", 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680776+0000", 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680789+0000", 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3190000000000001e-05 2024-09-16T04:09:15.514 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680818+0000", 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9221999999999999e-05 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.680843+0000", 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5341e-05 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.515 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681117+0000", 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027343099999999998 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.681133+0000", 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6121999999999999e-05 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756693+0000", 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.075560459999999996 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.516 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.756940+0000", 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000246987 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 5", 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.757281+0000", 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034121100000000001 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758584+0000", 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013029490000000001 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.517 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759577+0000", 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00099302500000000003 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759652+0000", 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4519999999999998e-05 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.759718+0000", 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5798999999999998e-05 2024-09-16T04:09:15.518 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 73.820295978999994, 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.074795126000000003, 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.519 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4260", 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/115886504", 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 1 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:09:15.520 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686483+0000", 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686485+0000", 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.658e-06 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.521 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686493+0000", 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4970000000000001e-06 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686508+0000", 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4491999999999999e-05 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.522 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686518+0000", 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0458e-05 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686592+0000", 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3489000000000001e-05 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for peered", 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.686600+0000", 2024-09-16T04:09:15.523 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9230000000000002e-06 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758022+0000", 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.071421947 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.524 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758412+0000", 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038979599999999998 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for subops from 0", 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.758762+0000", 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00035026099999999999 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op_commit", 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.760052+0000", 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012898219999999999 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.525 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_commit_rec", 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761194+0000", 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001142505 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761242+0000", 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7673000000000002e-05 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:01.761278+0000", 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.6604999999999999e-05 2024-09-16T04:09:15.526 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:10 3.2s0 3:47904bf5:::smithi20431790-4:head [append 0~65536,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.574682025999998, 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018864736, 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.527 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 10 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.528 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932097+0000", 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932099+0000", 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2199999999999999e-06 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932178+0000", 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.529 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932195+0000", 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7448999999999998e-05 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932210+0000", 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5338000000000001e-05 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932298+0000", 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8108000000000004e-05 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.530 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932407+0000", 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000108142 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933041+0000", 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00063471100000000004 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935398+0000", 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0023565420000000001 2024-09-16T04:09:15.531 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950884+0000", 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015486107000000001 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950962+0000", 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7970000000000001e-05 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.532 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:11 3.2s0 3:47904bf5:::smithi20431790-4:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.574524541000002, 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018963179, 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.533 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 11 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.534 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932255+0000", 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9400000000000005e-07 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932260+0000", 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9710000000000003e-06 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.535 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932272+0000", 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1394e-05 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932280+0000", 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6540000000000005e-06 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933560+0000", 2024-09-16T04:09:15.536 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012794550000000001 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.933703+0000", 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014327099999999999 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.934311+0000", 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00060811199999999995 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.537 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001087619 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951109+0000", 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015710114000000001 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951218+0000", 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010889499999999999 2024-09-16T04:09:15.538 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:12 3.2s0 3:47904bf5:::smithi20431790-4:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.574453249999998, 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026513838000000001, 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.539 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 12 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932326+0000", 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.540 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932327+0000", 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4600000000000003e-07 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932331+0000", 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932343+0000", 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2442999999999999e-05 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.932356+0000", 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2947e-05 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935242+0000", 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028857570000000001 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.542 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935348+0000", 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010570500000000001 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951277+0000", 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015929606999999998 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.951330+0000", 2024-09-16T04:09:15.543 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2148000000000003e-05 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.958840+0000", 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0075102520000000002 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:27 3.8s0 3:11971f68:::smithi20431790-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.567924558999998, 2024-09-16T04:09:15.544 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023242002000000001, 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 27 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.545 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938855+0000", 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3399999999999999e-07 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.546 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938866+0000", 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0725e-05 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938877+0000", 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1277999999999999e-05 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.938884+0000", 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1969999999999999e-06 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.547 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940649+0000", 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001764126 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940737+0000", 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8554000000000006e-05 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957784+0000", 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017047128000000002 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.548 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.957864+0000", 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9390999999999999e-05 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.962097+0000", 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0042329689999999996 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.549 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:39 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.559320724999999, 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018733970999999999, 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 39 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947458+0000", 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947459+0000", 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4000000000000002e-07 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.551 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947462+0000", 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8959999999999999e-06 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947471+0000", 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8680000000000005e-06 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.947477+0000", 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3300000000000004e-06 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.552 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950100+0000", 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026232159999999998 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.950184+0000", 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3891e-05 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963530+0000", 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013345658 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.553 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.554 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.554 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.963589+0000", 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8748000000000001e-05 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.966192+0000", 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026038239999999998 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.555 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:45 3.2s0 3:43e872cf:::smithi20431790-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.554414807000001, 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020624611000000001, 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 45 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.556 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952364+0000", 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952365+0000", 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.79e-07 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.557 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952366+0000", 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1400000000000001e-06 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952369+0000", 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5889999999999999e-06 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.952372+0000", 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7460000000000001e-06 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959119+0000", 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0067464609999999996 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.959501+0000", 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00038236699999999999 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970077+0000", 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010575599 2024-09-16T04:09:15.559 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.970122+0000", 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.5423999999999997e-05 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.972989+0000", 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028670060000000001 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.560 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:296 3.2s0 3:47aa9112:::smithi20431790-43:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.490121401000003, 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.022372174000000002, 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 296 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.561 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016658+0000", 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016661+0000", 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3730000000000001e-06 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.562 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016676+0000", 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4735999999999999e-05 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016718+0000", 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1995e-05 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016743+0000", 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4697000000000001e-05 2024-09-16T04:09:15.563 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016889+0000", 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014660300000000001 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016902+0000", 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3125000000000001e-05 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.028135+0000", 2024-09-16T04:09:15.564 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011232884 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.028307+0000", 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00017155600000000001 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.029615+0000", 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001308299 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038024+0000", 2024-09-16T04:09:15.565 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0084091359999999993 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038830+0000", 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00080528499999999999 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039030+0000", 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000200485 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.566 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:297 3.2s0 3:47aa9112:::smithi20431790-43:head [rollback 6] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.489976804000001, 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023235478, 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 297 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.567 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016802+0000", 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016803+0000", 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8999999999999995e-07 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.568 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016809+0000", 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.383e-06 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016840+0000", 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.1494e-05 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016852+0000", 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1909999999999999e-05 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.569 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016990+0000", 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013789100000000001 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016997+0000", 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.4989999999999997e-06 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.032055+0000", 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.015057667 2024-09-16T04:09:15.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.032258+0000", 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000203131 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.034469+0000", 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00221097 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.038026+0000", 2024-09-16T04:09:15.571 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003557017 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039824+0000", 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001797482 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040038+0000", 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00021414399999999999 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.572 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:298 3.2s0 3:47aa9112:::smithi20431790-43:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.489884818, 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026598553, 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 298 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.573 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016894+0000", 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016895+0000", 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7199999999999997e-07 2024-09-16T04:09:15.574 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016901+0000", 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2970000000000003e-06 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016914+0000", 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.364e-05 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016927+0000", 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3084e-05 2024-09-16T04:09:15.575 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017040+0000", 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000112871 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017045+0000", 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3240000000000002e-06 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.035806+0000", 2024-09-16T04:09:15.576 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.018760585 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.036098+0000", 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029218199999999999 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.037257+0000", 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001159207 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.039176+0000", 2024-09-16T04:09:15.577 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019182789999999999 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043033+0000", 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003857002 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043493+0000", 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046021000000000001 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.578 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:299 3.2s0 3:471dade1:::smithi20431790-28:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.489835792999997, 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.033537681, 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 299 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.579 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016943+0000", 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016944+0000", 2024-09-16T04:09:15.580 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3799999999999997e-07 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016949+0000", 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.3199999999999999e-06 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016963+0000", 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3137e-05 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.581 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016972+0000", 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.3600000000000002e-06 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017101+0000", 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000129536 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017109+0000", 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1080000000000004e-06 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.582 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040363+0000", 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023254582999999999 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040426+0000", 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2757999999999998e-05 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.040920+0000", 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00049433799999999998 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.583 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.046996+0000", 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0060755890000000002 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050239+0000", 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032429770000000002 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050481+0000", 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024233699999999999 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.584 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:300 3.2s0 3:471dade1:::smithi20431790-28:head [rollback 7] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.489795974000003, 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.034915521999999997, 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.585 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 300 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016983+0000", 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.586 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016984+0000", 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.75e-07 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016987+0000", 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.5599999999999998e-06 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.016999+0000", 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.117e-05 2024-09-16T04:09:15.587 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017008+0000", 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.4399999999999994e-06 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017152+0000", 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00014403800000000001 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017158+0000", 2024-09-16T04:09:15.588 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4580000000000001e-06 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043910+0000", 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.026752120000000001 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.044066+0000", 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000156408 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.589 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.045632+0000", 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0015661690000000001 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047448+0000", 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0018157169999999999 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.051829+0000", 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0043809010000000004 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.590 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.051899+0000", 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.9865999999999998e-05 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:301 3.2s0 3:471dade1:::smithi20431790-28:head [append 0~0] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.489760130000001, 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.037019252000000002, 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.591 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 301 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.592 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017019+0000", 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017020+0000", 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2799999999999996e-07 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017024+0000", 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8039999999999999e-06 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.593 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017034+0000", 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0631999999999999e-05 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017043+0000", 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2080000000000006e-06 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017183+0000", 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000140082 2024-09-16T04:09:15.594 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.017191+0000", 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.2400000000000001e-06 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047641+0000", 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.030450652000000002 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047877+0000", 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000235307 2024-09-16T04:09:15.595 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.049191+0000", 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013143950000000001 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.050617+0000", 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001426306 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.596 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.053870+0000", 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032524400000000001 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.054038+0000", 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016855799999999999 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:375 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [append 0~638976] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:09:15.597 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.651556577999997, 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.025565072000000001, 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.598 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 375 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.600 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855223+0000", 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.855226+0000", 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.23e-06 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858178+0000", 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029523180000000002 2024-09-16T04:09:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858274+0000", 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6217000000000004e-05 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858302+0000", 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8005999999999999e-05 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858504+0000", 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020172500000000001 2024-09-16T04:09:15.602 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858809+0000", 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00030490500000000001 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.861536+0000", 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027273269999999999 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.603 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867748+0000", 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0062119569999999997 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880622+0000", 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012873648999999999 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.880788+0000", 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016573799999999999 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.604 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:379 3.2s0 3:4dcd2a6f:::smithi20431790-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e48)", 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 44.637412056999999, 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.020566435000000001, 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.605 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 379 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869367+0000", 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.606 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869368+0000", 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.034e-06 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869372+0000", 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.1330000000000001e-06 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869383+0000", 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.1143e-05 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.607 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.869392+0000", 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.5569999999999996e-06 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883593+0000", 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014200855 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.883796+0000", 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00020284599999999999 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.608 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.887050+0000", 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032546789999999999 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.887240+0000", 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019004499999999999 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.889934+0000", 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026931429999999998 2024-09-16T04:09:15.609 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:542 3.2s0 3:47904bf5:::smithi20431790-4:head [copy-from ver 78] snapc 10=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.907029+0000", 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 28.599750598, 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.040957433000000001, 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.610 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 542 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907029+0000", 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907029+0000", 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.611 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907031+0000", 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8399999999999999e-06 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907045+0000", 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3327e-05 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907075+0000", 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0412e-05 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.612 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907094+0000", 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9057000000000001e-05 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907280+0000", 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018560899999999999 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907345+0000", 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5189000000000002e-05 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.613 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.910874+0000", 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003528743 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.911105+0000", 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00023097300000000001 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.945039+0000", 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.033933945 2024-09-16T04:09:15.614 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.947443+0000", 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0024045630000000002 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.947740+0000", 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029698700000000002 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.947986+0000", 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00024578799999999999 2024-09-16T04:09:15.615 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:543 3.2s0 3:47904bf5:::smithi20431790-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e64)", 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.907160+0000", 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 28.599618812999999, 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.039728354, 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.616 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 543 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907160+0000", 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907160+0000", 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.617 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907162+0000", 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6190000000000001e-06 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907170+0000", 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9699999999999999e-06 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907195+0000", 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5109999999999998e-05 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.618 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907214+0000", 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.8695999999999999e-05 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907503+0000", 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00028883799999999997 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.907520+0000", 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7373000000000001e-05 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.619 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.911325+0000", 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038049780000000001 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.911392+0000", 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7144000000000006e-05 2024-09-16T04:09:15.620 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.946709+0000", 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.035316985000000002 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.946793+0000", 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3605999999999999e-05 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.946889+0000", 2024-09-16T04:09:15.621 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.6034999999999998e-05 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:566 3.8s0 3:19f223a2:::smithi20431790-32:head [copy-from ver 9] snapc 11=[11] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:47.913533+0000", 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.593246069999999, 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.023827824000000001, 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.622 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 566 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913533+0000", 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913533+0000", 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.623 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913536+0000", 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8430000000000001e-06 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913570+0000", 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4218999999999999e-05 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913604+0000", 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.4053000000000001e-05 2024-09-16T04:09:15.624 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913622+0000", 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7496e-05 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913786+0000", 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016425700000000001 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.625 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913808+0000", 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2419999999999999e-05 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917311+0000", 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003502663 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917401+0000", 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0127e-05 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.626 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.932083+0000", 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014681654000000001 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934751+0000", 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026678079999999998 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.937235+0000", 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0024840539999999999 2024-09-16T04:09:15.627 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.937361+0000", 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012622999999999999 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:567 3.8s0 3:19f223a2:::smithi20431790-32:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:47.913655+0000", 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 27.593124678999999, 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.021092189000000001, 2024-09-16T04:09:15.628 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 567 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913655+0000", 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.629 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913655+0000", 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913656+0000", 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.5269999999999999e-06 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913663+0000", 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3889999999999999e-06 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.630 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913697+0000", 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3760000000000002e-05 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913708+0000", 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0662999999999999e-05 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913959+0000", 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00025156199999999999 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.631 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.913972+0000", 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2557e-05 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917557+0000", 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0035854849999999998 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.917596+0000", 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8275000000000002e-05 2024-09-16T04:09:15.632 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934111+0000", 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.016515133000000001 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934382+0000", 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027138500000000002 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:15.633 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:47.934747+0000", 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00036445299999999999 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:15.634 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:15.635 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-16T04:09:15.761 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:15.762 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:15.762 INFO:teuthology.orchestra.run.smithi204.stdout: "num_ops": 0 2024-09-16T04:09:15.762 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:15.776 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-16T04:09:15.899 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:15.899 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [], 2024-09-16T04:09:15.899 INFO:teuthology.orchestra.run.smithi204.stdout: "complaint_time": 30, 2024-09-16T04:09:15.900 INFO:teuthology.orchestra.run.smithi204.stdout: "num_blocked_ops": 0 2024-09-16T04:09:15.900 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:15.914 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-16T04:09:16.019 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-09-16T04:09:16.040 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-09-16T04:09:16.041 INFO:teuthology.orchestra.run.smithi204.stdout: "size": 20, 2024-09-16T04:09:16.041 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 600, 2024-09-16T04:09:16.041 INFO:teuthology.orchestra.run.smithi204.stdout: "ops": [ 2024-09-16T04:09:16.041 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.041 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:16 3.3s0 3:c529a602:::smithi20431790-6:head [append 0~98304,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:16.041 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:09:16.042 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.100562562, 2024-09-16T04:09:16.042 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019299383, 2024-09-16T04:09:16.042 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.042 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.042 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:16.043 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.043 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.043 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.043 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 16 2024-09-16T04:09:16.043 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.043 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.044 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.044 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.044 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:09:16.044 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.044 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.045 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.045 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.045 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935200+0000", 2024-09-16T04:09:16.045 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.045 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.045 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935202+0000", 2024-09-16T04:09:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1500000000000002e-06 2024-09-16T04:09:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.047 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935324+0000", 2024-09-16T04:09:16.047 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000121543 2024-09-16T04:09:16.047 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.047 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.047 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.048 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935343+0000", 2024-09-16T04:09:16.048 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9576e-05 2024-09-16T04:09:16.048 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.048 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.048 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.048 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935354+0000", 2024-09-16T04:09:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0305e-05 2024-09-16T04:09:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935432+0000", 2024-09-16T04:09:16.049 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8149e-05 2024-09-16T04:09:16.050 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.050 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.050 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.050 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935534+0000", 2024-09-16T04:09:16.050 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102352 2024-09-16T04:09:16.051 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.051 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.051 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.051 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936270+0000", 2024-09-16T04:09:16.051 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00073583600000000002 2024-09-16T04:09:16.051 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.052 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.052 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.052 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.940246+0000", 2024-09-16T04:09:16.052 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0039756180000000002 2024-09-16T04:09:16.052 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.053 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.053 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:16.053 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954404+0000", 2024-09-16T04:09:16.053 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014158278 2024-09-16T04:09:16.053 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.054 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.054 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.054 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954499+0000", 2024-09-16T04:09:16.054 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5575999999999994e-05 2024-09-16T04:09:16.054 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.054 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.055 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.055 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.055 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.055 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:17 3.3s0 3:c529a602:::smithi20431790-6:head [setxattr _header (55) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:16.055 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:09:16.055 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.100379384999997, 2024-09-16T04:09:16.056 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.019292492000000001, 2024-09-16T04:09:16.056 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.056 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.056 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:16.056 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.057 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.057 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.057 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 17 2024-09-16T04:09:16.057 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.057 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.058 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.058 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.058 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:09:16.058 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.058 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.058 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.059 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.059 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935383+0000", 2024-09-16T04:09:16.059 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.059 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.059 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.059 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.060 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935384+0000", 2024-09-16T04:09:16.060 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4099999999999997e-07 2024-09-16T04:09:16.060 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.060 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.060 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.061 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935389+0000", 2024-09-16T04:09:16.061 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2329999999999997e-06 2024-09-16T04:09:16.061 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.061 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.061 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.061 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935399+0000", 2024-09-16T04:09:16.062 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8409999999999995e-06 2024-09-16T04:09:16.062 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.062 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.062 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.062 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935409+0000", 2024-09-16T04:09:16.063 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.8600000000000005e-06 2024-09-16T04:09:16.063 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.063 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.063 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.063 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936658+0000", 2024-09-16T04:09:16.063 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0012486140000000001 2024-09-16T04:09:16.064 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.064 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.064 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.064 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.936736+0000", 2024-09-16T04:09:16.064 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8772999999999999e-05 2024-09-16T04:09:16.065 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.065 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.065 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.065 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937204+0000", 2024-09-16T04:09:16.065 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00046781200000000001 2024-09-16T04:09:16.065 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.066 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.066 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.066 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.941222+0000", 2024-09-16T04:09:16.066 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0040175799999999998 2024-09-16T04:09:16.066 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.067 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.067 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:16.067 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954596+0000", 2024-09-16T04:09:16.067 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.013374425000000001 2024-09-16T04:09:16.067 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.067 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.068 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.068 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.954676+0000", 2024-09-16T04:09:16.068 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9512999999999996e-05 2024-09-16T04:09:16.068 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.068 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.068 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.069 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.069 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.069 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:18 3.3s0 3:c529a602:::smithi20431790-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e33)", 2024-09-16T04:09:16.069 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:16.069 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.100342038000001, 2024-09-16T04:09:16.070 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.028831239000000002, 2024-09-16T04:09:16.070 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.070 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.070 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.070 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.070 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.071 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.071 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 18 2024-09-16T04:09:16.071 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.071 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.071 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.071 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.072 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:16.072 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.072 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.072 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.072 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.073 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:16.073 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.073 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.073 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.073 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.073 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935421+0000", 2024-09-16T04:09:16.074 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.4700000000000001e-07 2024-09-16T04:09:16.074 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.074 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.074 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.074 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935425+0000", 2024-09-16T04:09:16.074 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3689999999999998e-06 2024-09-16T04:09:16.075 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.075 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.075 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.075 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935433+0000", 2024-09-16T04:09:16.075 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4379999999999995e-06 2024-09-16T04:09:16.076 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.076 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.076 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.076 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.935442+0000", 2024-09-16T04:09:16.076 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2660000000000007e-06 2024-09-16T04:09:16.077 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.077 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.077 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.077 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937434+0000", 2024-09-16T04:09:16.077 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001991488 2024-09-16T04:09:16.077 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.078 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.078 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:16.078 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.937526+0000", 2024-09-16T04:09:16.078 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.2130000000000001e-05 2024-09-16T04:09:16.078 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.079 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.079 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.079 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955047+0000", 2024-09-16T04:09:16.079 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01752107 2024-09-16T04:09:16.079 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.079 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.955134+0000", 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.7058000000000006e-05 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.964252+0000", 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091177729999999992 2024-09-16T04:09:16.080 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:54 3.3s0 3:cd6753c4:::smithi20431790-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.070090991000001, 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012514735000000001, 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.081 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 54 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.082 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965672+0000", 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8500000000000002e-07 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965675+0000", 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.717e-06 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965681+0000", 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.3740000000000003e-06 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.083 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.965688+0000", 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1319999999999996e-06 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967631+0000", 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001942608 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.967683+0000", 2024-09-16T04:09:16.084 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.2407000000000002e-05 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0065591089999999996 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974296+0000", 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.304e-05 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978186+0000", 2024-09-16T04:09:16.085 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003890863 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:61 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [append 0~344064,stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.061893089999998, 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014009466, 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.086 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 61 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973870+0000", 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.087 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.973871+0000", 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.42e-06 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974203+0000", 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000331649 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974215+0000", 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.2428e-05 2024-09-16T04:09:16.088 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974223+0000", 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.4090000000000003e-06 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974499+0000", 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00027562300000000001 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974613+0000", 2024-09-16T04:09:16.089 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00011410500000000001 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.975669+0000", 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0010556929999999999 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978426+0000", 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0027567379999999999 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987790+0000", 2024-09-16T04:09:16.090 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093645580000000003 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987879+0000", 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.8843000000000003e-05 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:62 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [setxattr _header (56) in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.061521921000001, 2024-09-16T04:09:16.091 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.01382477, 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 62 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.092 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974241+0000", 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974242+0000", 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.043e-06 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974246+0000", 2024-09-16T04:09:16.093 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.7500000000000003e-06 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974255+0000", 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.6889999999999993e-06 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974262+0000", 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.8020000000000003e-06 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976035+0000", 2024-09-16T04:09:16.094 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001773513 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976098+0000", 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.2561e-05 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.976446+0000", 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00034762200000000001 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.978428+0000", 2024-09-16T04:09:16.095 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0019825789999999999 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.987964+0000", 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0095358739999999997 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988065+0000", 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000101337 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.096 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:63 3.3s0 3:cd4f3bbe:::smithi20431790-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 59.061493538000001, 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.017999409000000001, 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 63 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.097 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974269+0000", 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0200000000000003e-07 2024-09-16T04:09:16.098 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974272+0000", 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6450000000000001e-06 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974280+0000", 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.3900000000000004e-06 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.974287+0000", 2024-09-16T04:09:16.099 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.9410000000000007e-06 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977414+0000", 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031265419999999999 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.977505+0000", 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0589999999999998e-05 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988472+0000", 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010967144999999999 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.988572+0000", 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.9774999999999999e-05 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:16.992268+0000", 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.003696979 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.101 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:123 3.3s0 3:cbefa139:::smithi20431790-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e34)", 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 58.990139841999998, 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0091212429999999994, 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 123 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.102 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045623+0000", 2024-09-16T04:09:16.103 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0999999999999998e-07 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045626+0000", 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.7360000000000001e-06 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045634+0000", 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.469e-06 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.045640+0000", 2024-09-16T04:09:16.104 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.7340000000000002e-06 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048271+0000", 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026307589999999999 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.048353+0000", 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.2093000000000002e-05 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.105 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053037+0000", 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0046837609999999998 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.053109+0000", 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.1594999999999995e-05 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:17.054744+0000", 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001635486 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.106 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:290 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 49.990779672000002, 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092576150000000003, 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 290 2024-09-16T04:09:16.107 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044983+0000", 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.108 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044984+0000", 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.0699999999999996e-07 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.044990+0000", 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6370000000000002e-06 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045001+0000", 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.0253e-05 2024-09-16T04:09:16.109 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045008+0000", 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5179999999999998e-06 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045111+0000", 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000102534 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045116+0000", 2024-09-16T04:09:16.110 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.5729999999999998e-06 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047750+0000", 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0026333289999999998 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.047840+0000", 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.0716000000000004e-05 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.111 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.054241+0000", 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064002479999999999 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:291 3.3s0 3:cd4f3bbe:::smithi20431790-21:6 [read 0~1425408,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 49.990743254999998, 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010030295999999999, 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.112 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 291 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.113 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045019+0000", 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045020+0000", 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.8100000000000003e-07 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045024+0000", 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.8580000000000002e-06 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.114 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045032+0000", 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3310000000000004e-06 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045039+0000", 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.6320000000000002e-06 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045164+0000", 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00012537599999999999 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.115 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting_for_map not empty", 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.045172+0000", 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5750000000000003e-06 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048140+0000", 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029680029999999999 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.048205+0000", 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.5269000000000001e-05 2024-09-16T04:09:16.116 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:26.055050+0000", 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0068446710000000001 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:307 3.3s0 3:c529a602:::smithi20431790-6:head [rollback 7] snapc 7=[7,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 48.992585654999999, 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010861308, 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.117 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 307 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.118 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043177+0000", 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043180+0000", 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.3500000000000001e-06 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043196+0000", 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.6101999999999999e-05 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.119 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043245+0000", 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.8809e-05 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043270+0000", 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4379000000000002e-05 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043464+0000", 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019390799999999999 2024-09-16T04:09:16.120 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "op must wait for map", 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.043483+0000", 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9568999999999998e-05 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047345+0000", 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0038619930000000002 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.121 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.047636+0000", 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00029135800000000002 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:27.054038+0000", 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0064018399999999998 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 48/31 ECSubWrite(tid=145, reqid=osd.10.0:145, at_version=48'44, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 45.178894008, 2024-09-16T04:09:16.122 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010163948000000001, 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856869+0000", 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.123 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856870+0000", 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.297e-06 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856931+0000", 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 6.0594000000000003e-05 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856960+0000", 2024-09-16T04:09:16.124 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.9413000000000001e-05 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.856983+0000", 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.2623e-05 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857134+0000", 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00015194899999999999 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.125 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857159+0000", 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4603000000000001e-05 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.866937+0000", 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0097774980000000008 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867033+0000", 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.5971000000000007e-05 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.126 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.bs3 48/31 ECSubWrite(tid=146, reqid=osd.10.0:146, at_version=48'66, trim_to=0'0, roll_forward_to=46'62))", 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 45.178541613999997, 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0099345739999999998, 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.127 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857221+0000", 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857222+0000", 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.176e-06 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857325+0000", 2024-09-16T04:09:16.128 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010283799999999999 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857351+0000", 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6325999999999998e-05 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857371+0000", 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9854999999999999e-05 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.129 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857658+0000", 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000286347 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857684+0000", 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.6879000000000001e-05 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867077+0000", 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093926080000000002 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.130 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.867156+0000", 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.8545000000000001e-05 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.4s4 48/31 ECSubWrite(tid=147, reqid=osd.10.0:147, at_version=48'46, trim_to=0'0, roll_forward_to=46'42))", 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 45.178307681, 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012877899, 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:16.131 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857455+0000", 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857456+0000", 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.13e-06 2024-09-16T04:09:16.132 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857497+0000", 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.0889000000000001e-05 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857521+0000", 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3635999999999999e-05 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857630+0000", 2024-09-16T04:09:16.133 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00010979700000000001 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.860884+0000", 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0032533760000000001 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.860915+0000", 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 3.0966999999999997e-05 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.134 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870250+0000", 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0093347870000000006 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870333+0000", 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.3317000000000002e-05 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.8s3 48/31 ECSubWrite(tid=224, reqid=osd.11.0:224, at_version=48'15, trim_to=0'0, roll_forward_to=47'13))", 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:09:16.135 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 45.177909261000003, 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012440777, 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.136 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857853+0000", 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857854+0000", 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.006e-06 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857909+0000", 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 5.4805999999999997e-05 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.137 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857933+0000", 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3468999999999998e-05 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.857952+0000", 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9150000000000001e-05 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858117+0000", 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016526799999999999 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.138 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.858143+0000", 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5887000000000001e-05 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870197+0000", 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012053927000000001 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:30.870294+0000", 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7263999999999996e-05 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.139 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:523 3.3s0 3:cd6753c4:::smithi20431790-18:head [copy-from ver 6] snapc 10=[f] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 29.837352836000001, 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.014171206, 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.140 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 523 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198410+0000", 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.141 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198413+0000", 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.8449999999999999e-06 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198434+0000", 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.0877e-05 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198483+0000", 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 4.9058999999999999e-05 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.142 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198500+0000", 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7456999999999999e-05 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198657+0000", 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000157069 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198968+0000", 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00031080000000000002 2024-09-16T04:09:16.143 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.208172+0000", 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0092042619999999995 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.211163+0000", 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0029903820000000002 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.212391+0000", 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001228385 2024-09-16T04:09:16.144 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.212581+0000", 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00019007 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:524 3.3s0 3:cd6753c4:::smithi20431790-18:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e63)", 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 29.837225450999998, 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.012231209, 2024-09-16T04:09:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 524 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.146 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198537+0000", 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198538+0000", 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.237e-06 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198546+0000", 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.7149999999999998e-06 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.147 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198572+0000", 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5746999999999999e-05 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.198585+0000", 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.3339999999999999e-05 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.199477+0000", 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00089197600000000005 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.148 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for blocked object", 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.199599+0000", 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000122018 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210447+0000", 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010848116999999999 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210634+0000", 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00018665899999999999 2024-09-16T04:09:16.149 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:46.210768+0000", 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013439999999999999 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "MOSDECSubOpWrite(3.8s3 74/69 ECSubWrite(tid=358, reqid=osd.10.0:358, at_version=74'41, trim_to=0'0, roll_forward_to=70'39))", 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:56.863091+0000", 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 19.172671448999999, 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.011730251000000001, 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.150 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "reached pg", 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.863091+0000", 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.863091+0000", 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.151 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.863092+0000", 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 7.5600000000000005e-07 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.864536+0000", 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0014435979999999999 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867389+0000", 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0028531950000000002 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.152 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867414+0000", 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.5673e-05 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867576+0000", 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00016150999999999999 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.867600+0000", 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.4533999999999999e-05 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.153 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.874724+0000", 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00712314 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:56.874821+0000", 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 9.7844999999999996e-05 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:769 3.3s0 3:c529a602:::smithi20431790-6:head [append 0~573440] snapc 17=[17,16,15,14] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:16.154 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.294376+0000", 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.741387052, 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0088758199999999995, 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 769 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.155 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294376+0000", 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294376+0000", 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294377+0000", 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.7659999999999999e-06 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.156 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294799+0000", 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00042189000000000001 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294821+0000", 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.1656999999999999e-05 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294844+0000", 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 2.3039000000000001e-05 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.157 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.294960+0000", 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000115982 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.295117+0000", 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000156914 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_started", 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.296472+0000", 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0013554019999999999 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.158 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "sub_op_committed", 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298170+0000", 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.001698123 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "commit_sent", 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.303047+0000", 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0048763310000000002 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.303251+0000", 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000204716 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.159 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "description": "osd_op(client.4631.0:772 3.3s0 3:c529a602:::smithi20431790-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e74)", 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "initiated_at": "2024-09-16T04:08:57.298679+0000", 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "age": 18.737083859999998, 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.010151774000000001, 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "continuous": false, 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "type_data": { 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "flag_point": "started", 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "client_info": { 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "client": "client.4631", 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "client_addr": "172.21.15.204:0/1455934923", 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: "tid": 772 2024-09-16T04:09:16.160 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "events": [ 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "initiated", 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298679+0000", 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "header_read", 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298679+0000", 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "throttled", 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298680+0000", 2024-09-16T04:09:16.161 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.4699999999999999e-06 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "all_read", 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298688+0000", 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 8.1629999999999996e-06 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "dispatched", 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298708+0000", 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.9789999999999999e-05 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "queued_for_pg", 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.298723+0000", 2024-09-16T04:09:16.162 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 1.435e-05 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.304417+0000", 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0056943899999999997 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "waiting for rw locks", 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.304547+0000", 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00013039099999999999 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "reached_pg", 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.305406+0000", 2024-09-16T04:09:16.163 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.00085826399999999997 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "started", 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.305652+0000", 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.000246536 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: { 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: "event": "done", 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: "time": "2024-09-16T04:08:57.308831+0000", 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: "duration": 0.0031784199999999999 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.164 INFO:teuthology.orchestra.run.smithi204.stdout: } 2024-09-16T04:09:16.165 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-09-16T04:09:16.165 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-09-16T04:09:16.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-16T04:09:17.021 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.12 to 1 (10000) 2024-09-16T04:09:17.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 12 1 2024-09-16T04:09:18.039 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.12 primary-affinity to 1 (8655362) 2024-09-16T04:09:18.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T04:09:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T04:09:19.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-16T04:09:19.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-16T04:09:19.400+0000 7f4fb68b5640 0 --2- 172.21.15.32:0/3421845904 >> v2:172.21.15.196:3300/0 conn(0x7f4fb00c9e20 0x7f4fb00c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T04:09:20.051 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-16T04:09:20.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-16T04:09:21.061 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-09-16T04:09:21.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-16T04:09:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-16T04:09:22.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-16T04:09:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.9 to 1 (10000) 2024-09-16T04:09:23.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 1 2024-09-16T04:09:24.088 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-09-16T04:09:24.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-16T04:09:25.097 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.13 to 1 (10000) 2024-09-16T04:09:25.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 1 2024-09-16T04:09:26.107 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.13 primary-affinity to 1 (8655362) 2024-09-16T04:09:26.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T04:09:27.118 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T04:09:27.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-16T04:09:28.137 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-16T04:09:28.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-16T04:09:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-09-16T04:09:29.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-16T04:09:30.154 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-16T04:09:30.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-16T04:09:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.10 to 1 (10000) 2024-09-16T04:09:31.182 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 10 1 2024-09-16T04:09:32.166 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-09-16T04:09:32.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-16T04:09:33.175 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.14 to 1 (10000) 2024-09-16T04:09:33.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 1 2024-09-16T04:09:34.185 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.14 primary-affinity to 1 (8655362) 2024-09-16T04:09:34.212 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T04:09:35.195 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T04:09:35.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-16T04:09:36.206 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-16T04:09:36.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-16T04:09:37.216 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-09-16T04:09:37.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-16T04:09:38.227 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-16T04:09:38.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-16T04:09:39.236 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.11 to 1 (10000) 2024-09-16T04:09:39.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 1 2024-09-16T04:09:40.245 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-09-16T04:09:40.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-16T04:09:41.255 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.15 to 1 (10000) 2024-09-16T04:09:41.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-09-16T04:09:42.264 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-09-16T04:09:42.289 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-16T04:09:42.289 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-16T04:09:42.289 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-16T04:09:42.289 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-16T04:09:42.289 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T04:09:42.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:09:42.597 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:42.597 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":119,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:09:42.256505+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:09:09.950161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T04:08:00.056722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T04:08:00.124851+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0100002288818359,"score_stable":4.0100002288818359,"optimal_score":0.81000000238418579,"raw_score_acting":3.25,"raw_score_stable":3.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:06.947713+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:27.105222+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:25.623618+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:00.147346+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.536144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:16.340857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.487279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.732168+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:02.265781+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:15.416849+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:15.452794+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:22.861739+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:16.226440+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.138963+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:11.738538+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:10.960319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":21,"length":1},{"begin":23,"length":1},{"begin":26,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:09:42.617 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T04:09:42.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:09:42.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:42.908 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":119,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:09:42.256505+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:09:09.950161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T04:08:00.056722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T04:08:00.124851+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0100002288818359,"score_stable":4.0100002288818359,"optimal_score":0.81000000238418579,"raw_score_acting":3.25,"raw_score_stable":3.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:06.947713+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:27.105222+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:25.623618+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:00.147346+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.536144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:16.340857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.487279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.732168+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:02.265781+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:15.416849+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:15.452794+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:22.861739+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:16.226440+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.138963+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:11.738538+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:10.960319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":21,"length":1},{"begin":23,"length":1},{"begin":26,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:09:42.929 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T04:09:42.929 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T04:09:42.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T04:09:42.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T04:09:42.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T04:09:42.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T04:09:42.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T04:09:42.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T04:09:42.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-16T04:09:42.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-16T04:09:42.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-16T04:09:42.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-16T04:09:42.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-16T04:09:42.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-16T04:09:42.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-16T04:09:42.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-16T04:09:43.343 INFO:teuthology.orchestra.run.smithi032.stdout:98784247832 2024-09-16T04:09:43.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-16T04:09:43.402 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:43.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T04:09:43.403 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:43.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-16T04:09:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:98784247832 2024-09-16T04:09:43.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-16T04:09:43.421 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:43.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T04:09:43.423 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:43.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-16T04:09:43.425 INFO:teuthology.orchestra.run.smithi032.stdout:94489280536 2024-09-16T04:09:43.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-16T04:09:43.443 INFO:teuthology.orchestra.run.smithi032.stdout:90194313240 2024-09-16T04:09:43.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T04:09:43.447 INFO:teuthology.orchestra.run.smithi032.stdout:98784247833 2024-09-16T04:09:43.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T04:09:43.470 INFO:teuthology.orchestra.run.smithi032.stdout:94489280536 2024-09-16T04:09:43.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T04:09:43.486 INFO:teuthology.orchestra.run.smithi032.stdout:98784247832 2024-09-16T04:09:43.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T04:09:43.498 INFO:teuthology.orchestra.run.smithi032.stdout:94489280536 2024-09-16T04:09:43.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T04:09:43.508 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:43.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T04:09:43.522 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:43.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-16T04:09:43.541 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:43.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-16T04:09:43.606 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:43.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-16T04:09:44.310 INFO:teuthology.orchestra.run.smithi032.stdout:98784247832 2024-09-16T04:09:44.323 INFO:teuthology.orchestra.run.smithi032.stdout:94489280536 2024-09-16T04:09:44.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247832 got 98784247832 for osd.12 2024-09-16T04:09:44.369 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280536 got 94489280536 for osd.13 2024-09-16T04:09:44.385 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.391 INFO:teuthology.orchestra.run.smithi032.stdout:98784247833 2024-09-16T04:09:44.392 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:44.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247833 got 98784247833 for osd.3 2024-09-16T04:09:44.436 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247831 got 98784247831 for osd.0 2024-09-16T04:09:44.446 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.450 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:44.473 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:44.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280537 for osd.11 2024-09-16T04:09:44.495 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247831 got 98784247831 for osd.4 2024-09-16T04:09:44.519 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.531 INFO:teuthology.orchestra.run.smithi032.stdout:98784247832 2024-09-16T04:09:44.542 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:44.543 INFO:teuthology.orchestra.run.smithi032.stdout:94489280536 2024-09-16T04:09:44.552 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:44.555 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:44.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247832 got 98784247832 for osd.14 2024-09-16T04:09:44.561 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.570 INFO:teuthology.orchestra.run.smithi032.stdout:94489280537 2024-09-16T04:09:44.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280537 for osd.10 2024-09-16T04:09:44.573 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.583 INFO:teuthology.orchestra.run.smithi032.stdout:90194313241 2024-09-16T04:09:44.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247831 got 98784247831 for osd.15 2024-09-16T04:09:44.585 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280537 for osd.9 2024-09-16T04:09:44.590 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.592 INFO:teuthology.orchestra.run.smithi032.stdout:98784247832 2024-09-16T04:09:44.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280536 got 94489280536 for osd.1 2024-09-16T04:09:44.601 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280537 got 94489280537 for osd.7 2024-09-16T04:09:44.604 INFO:teuthology.orchestra.run.smithi032.stdout:94489280536 2024-09-16T04:09:44.604 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313240 got 90194313241 for osd.2 2024-09-16T04:09:44.616 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247832 got 98784247832 for osd.6 2024-09-16T04:09:44.622 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280536 got 94489280536 for osd.5 2024-09-16T04:09:44.624 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.632 INFO:teuthology.orchestra.run.smithi032.stdout:98784247831 2024-09-16T04:09:44.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247831 got 98784247831 for osd.8 2024-09-16T04:09:44.649 DEBUG:teuthology.parallel:result is None 2024-09-16T04:09:44.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T04:09:44.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:44.993 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-16T04:09:43.996199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":523760,"kb_used_data":28824,"kb_used_omap":24,"kb_used_meta":494503,"kb_avail":1509425680,"statfs":{"total":1546188226560,"available":1545651896320,"internally_reserved":0,"allocated":29515776,"data_stored":17583422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":506371151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.763804"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":402,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678523+0000","last_change":"2024-09-16T04:09:23.019365+0000","last_active":"2024-09-16T04:09:42.678523+0000","last_peered":"2024-09-16T04:09:42.678523+0000","last_clean":"2024-09-16T04:09:42.678523+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:42.678523+0000","last_undegraded":"2024-09-16T04:09:42.678523+0000","last_fullsized":"2024-09-16T04:09:42.678523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_clean_scrub_stamp":"2024-09-16T04:09:23.019102+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:44.166795+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678575+0000","last_change":"2024-09-16T04:09:20.944577+0000","last_active":"2024-09-16T04:09:42.678575+0000","last_peered":"2024-09-16T04:09:42.678575+0000","last_clean":"2024-09-16T04:09:42.678575+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:42.678575+0000","last_undegraded":"2024-09-16T04:09:42.678575+0000","last_fullsized":"2024-09-16T04:09:42.678575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-16T04:09:20.944197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:20.944197+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:43.199430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.751368+0000","last_change":"2024-09-16T04:09:19.635816+0000","last_active":"2024-09-16T04:09:42.751368+0000","last_peered":"2024-09-16T04:09:42.751368+0000","last_clean":"2024-09-16T04:09:42.751368+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:42.751368+0000","last_undegraded":"2024-09-16T04:09:42.751368+0000","last_fullsized":"2024-09-16T04:09:42.751368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:19.635466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:19.635466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.106951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.785609+0000","last_change":"2024-09-16T04:09:14.986897+0000","last_active":"2024-09-16T04:09:42.785609+0000","last_peered":"2024-09-16T04:09:42.785609+0000","last_clean":"2024-09-16T04:09:42.785609+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:42.785609+0000","last_undegraded":"2024-09-16T04:09:42.785609+0000","last_fullsized":"2024-09-16T04:09:42.785609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_clean_scrub_stamp":"2024-09-16T04:09:14.986737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:42.504610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490986+0000","last_change":"2024-09-16T04:09:31.870143+0000","last_active":"2024-09-16T04:09:42.490986+0000","last_peered":"2024-09-16T04:09:42.490986+0000","last_clean":"2024-09-16T04:09:42.490986+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:42.490986+0000","last_undegraded":"2024-09-16T04:09:42.490986+0000","last_fullsized":"2024-09-16T04:09:42.490986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_clean_scrub_stamp":"2024-09-16T04:09:31.869801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:48.850138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.750480+0000","last_change":"2024-09-16T04:09:27.858245+0000","last_active":"2024-09-16T04:09:42.750480+0000","last_peered":"2024-09-16T04:09:42.750480+0000","last_clean":"2024-09-16T04:09:42.750480+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:42.750480+0000","last_undegraded":"2024-09-16T04:09:42.750480+0000","last_fullsized":"2024-09-16T04:09:42.750480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:27.857978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:27.857978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:40.872158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.748467+0000","last_change":"2024-09-16T04:09:11.352610+0000","last_active":"2024-09-16T04:09:42.748467+0000","last_peered":"2024-09-16T04:09:42.748467+0000","last_clean":"2024-09-16T04:09:42.748467+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:09:42.748467+0000","last_undegraded":"2024-09-16T04:09:42.748467+0000","last_fullsized":"2024-09-16T04:09:42.748467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:08.317815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:08.317815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.544247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:43.152046+0000","last_change":"2024-09-16T04:09:12.858831+0000","last_active":"2024-09-16T04:09:43.152046+0000","last_peered":"2024-09-16T04:09:43.152046+0000","last_clean":"2024-09-16T04:09:43.152046+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:43.152046+0000","last_undegraded":"2024-09-16T04:09:43.152046+0000","last_fullsized":"2024-09-16T04:09:43.152046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:12.858665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:12.858665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.829775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490988+0000","last_change":"2024-09-16T04:09:16.945224+0000","last_active":"2024-09-16T04:09:42.490988+0000","last_peered":"2024-09-16T04:09:42.490988+0000","last_clean":"2024-09-16T04:09:42.490988+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:42.490988+0000","last_undegraded":"2024-09-16T04:09:42.490988+0000","last_fullsized":"2024-09-16T04:09:42.490988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_clean_scrub_stamp":"2024-09-16T04:09:16.944907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.888239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313241,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28760,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343080,"statfs":{"total":96636764160,"available":96607313920,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280537,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33448,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338392,"statfs":{"total":96636764160,"available":96602513408,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280536,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247831,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33436,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338404,"statfs":{"total":96636764160,"available":96602525696,"internally_reserved":0,"allocated":2297856,"data_stored":1554560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247831,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:44.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:45.280 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:45.280 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:45.297 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-16T04:09:43.996199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":523760,"kb_used_data":28824,"kb_used_omap":24,"kb_used_meta":494503,"kb_avail":1509425680,"statfs":{"total":1546188226560,"available":1545651896320,"internally_reserved":0,"allocated":29515776,"data_stored":17583422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":506371151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.763804"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":402,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678523+0000","last_change":"2024-09-16T04:09:23.019365+0000","last_active":"2024-09-16T04:09:42.678523+0000","last_peered":"2024-09-16T04:09:42.678523+0000","last_clean":"2024-09-16T04:09:42.678523+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:42.678523+0000","last_undegraded":"2024-09-16T04:09:42.678523+0000","last_fullsized":"2024-09-16T04:09:42.678523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_clean_scrub_stamp":"2024-09-16T04:09:23.019102+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:44.166795+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678575+0000","last_change":"2024-09-16T04:09:20.944577+0000","last_active":"2024-09-16T04:09:42.678575+0000","last_peered":"2024-09-16T04:09:42.678575+0000","last_clean":"2024-09-16T04:09:42.678575+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:42.678575+0000","last_undegraded":"2024-09-16T04:09:42.678575+0000","last_fullsized":"2024-09-16T04:09:42.678575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-16T04:09:20.944197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:20.944197+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:43.199430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.751368+0000","last_change":"2024-09-16T04:09:19.635816+0000","last_active":"2024-09-16T04:09:42.751368+0000","last_peered":"2024-09-16T04:09:42.751368+0000","last_clean":"2024-09-16T04:09:42.751368+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:42.751368+0000","last_undegraded":"2024-09-16T04:09:42.751368+0000","last_fullsized":"2024-09-16T04:09:42.751368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:19.635466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:19.635466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.106951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.785609+0000","last_change":"2024-09-16T04:09:14.986897+0000","last_active":"2024-09-16T04:09:42.785609+0000","last_peered":"2024-09-16T04:09:42.785609+0000","last_clean":"2024-09-16T04:09:42.785609+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:42.785609+0000","last_undegraded":"2024-09-16T04:09:42.785609+0000","last_fullsized":"2024-09-16T04:09:42.785609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_clean_scrub_stamp":"2024-09-16T04:09:14.986737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:42.504610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490986+0000","last_change":"2024-09-16T04:09:31.870143+0000","last_active":"2024-09-16T04:09:42.490986+0000","last_peered":"2024-09-16T04:09:42.490986+0000","last_clean":"2024-09-16T04:09:42.490986+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:42.490986+0000","last_undegraded":"2024-09-16T04:09:42.490986+0000","last_fullsized":"2024-09-16T04:09:42.490986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_clean_scrub_stamp":"2024-09-16T04:09:31.869801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:48.850138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.750480+0000","last_change":"2024-09-16T04:09:27.858245+0000","last_active":"2024-09-16T04:09:42.750480+0000","last_peered":"2024-09-16T04:09:42.750480+0000","last_clean":"2024-09-16T04:09:42.750480+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:42.750480+0000","last_undegraded":"2024-09-16T04:09:42.750480+0000","last_fullsized":"2024-09-16T04:09:42.750480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:27.857978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:27.857978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:40.872158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.748467+0000","last_change":"2024-09-16T04:09:11.352610+0000","last_active":"2024-09-16T04:09:42.748467+0000","last_peered":"2024-09-16T04:09:42.748467+0000","last_clean":"2024-09-16T04:09:42.748467+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:09:42.748467+0000","last_undegraded":"2024-09-16T04:09:42.748467+0000","last_fullsized":"2024-09-16T04:09:42.748467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:08.317815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:08.317815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.544247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:43.152046+0000","last_change":"2024-09-16T04:09:12.858831+0000","last_active":"2024-09-16T04:09:43.152046+0000","last_peered":"2024-09-16T04:09:43.152046+0000","last_clean":"2024-09-16T04:09:43.152046+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:43.152046+0000","last_undegraded":"2024-09-16T04:09:43.152046+0000","last_fullsized":"2024-09-16T04:09:43.152046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:12.858665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:12.858665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.829775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490988+0000","last_change":"2024-09-16T04:09:16.945224+0000","last_active":"2024-09-16T04:09:42.490988+0000","last_peered":"2024-09-16T04:09:42.490988+0000","last_clean":"2024-09-16T04:09:42.490988+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:42.490988+0000","last_undegraded":"2024-09-16T04:09:42.490988+0000","last_fullsized":"2024-09-16T04:09:42.490988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_clean_scrub_stamp":"2024-09-16T04:09:16.944907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.888239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313241,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28760,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343080,"statfs":{"total":96636764160,"available":96607313920,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280537,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33448,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338392,"statfs":{"total":96636764160,"available":96602513408,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280536,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247831,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33436,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338404,"statfs":{"total":96636764160,"available":96602525696,"internally_reserved":0,"allocated":2297856,"data_stored":1554560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247831,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:45.299 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T04:09:45.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-16T04:09:45.617 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T04:09:45.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T04:09:45.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:45.923 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:45.940 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-16T04:09:43.996199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":523760,"kb_used_data":28824,"kb_used_omap":24,"kb_used_meta":494503,"kb_avail":1509425680,"statfs":{"total":1546188226560,"available":1545651896320,"internally_reserved":0,"allocated":29515776,"data_stored":17583422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":506371151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.763804"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":402,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678523+0000","last_change":"2024-09-16T04:09:23.019365+0000","last_active":"2024-09-16T04:09:42.678523+0000","last_peered":"2024-09-16T04:09:42.678523+0000","last_clean":"2024-09-16T04:09:42.678523+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:42.678523+0000","last_undegraded":"2024-09-16T04:09:42.678523+0000","last_fullsized":"2024-09-16T04:09:42.678523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_clean_scrub_stamp":"2024-09-16T04:09:23.019102+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:44.166795+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678575+0000","last_change":"2024-09-16T04:09:20.944577+0000","last_active":"2024-09-16T04:09:42.678575+0000","last_peered":"2024-09-16T04:09:42.678575+0000","last_clean":"2024-09-16T04:09:42.678575+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:42.678575+0000","last_undegraded":"2024-09-16T04:09:42.678575+0000","last_fullsized":"2024-09-16T04:09:42.678575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-16T04:09:20.944197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:20.944197+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:43.199430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.751368+0000","last_change":"2024-09-16T04:09:19.635816+0000","last_active":"2024-09-16T04:09:42.751368+0000","last_peered":"2024-09-16T04:09:42.751368+0000","last_clean":"2024-09-16T04:09:42.751368+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:42.751368+0000","last_undegraded":"2024-09-16T04:09:42.751368+0000","last_fullsized":"2024-09-16T04:09:42.751368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:19.635466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:19.635466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.106951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.785609+0000","last_change":"2024-09-16T04:09:14.986897+0000","last_active":"2024-09-16T04:09:42.785609+0000","last_peered":"2024-09-16T04:09:42.785609+0000","last_clean":"2024-09-16T04:09:42.785609+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:42.785609+0000","last_undegraded":"2024-09-16T04:09:42.785609+0000","last_fullsized":"2024-09-16T04:09:42.785609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_clean_scrub_stamp":"2024-09-16T04:09:14.986737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:42.504610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490986+0000","last_change":"2024-09-16T04:09:31.870143+0000","last_active":"2024-09-16T04:09:42.490986+0000","last_peered":"2024-09-16T04:09:42.490986+0000","last_clean":"2024-09-16T04:09:42.490986+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:42.490986+0000","last_undegraded":"2024-09-16T04:09:42.490986+0000","last_fullsized":"2024-09-16T04:09:42.490986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_clean_scrub_stamp":"2024-09-16T04:09:31.869801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:48.850138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.750480+0000","last_change":"2024-09-16T04:09:27.858245+0000","last_active":"2024-09-16T04:09:42.750480+0000","last_peered":"2024-09-16T04:09:42.750480+0000","last_clean":"2024-09-16T04:09:42.750480+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:42.750480+0000","last_undegraded":"2024-09-16T04:09:42.750480+0000","last_fullsized":"2024-09-16T04:09:42.750480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:27.857978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:27.857978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:40.872158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.748467+0000","last_change":"2024-09-16T04:09:11.352610+0000","last_active":"2024-09-16T04:09:42.748467+0000","last_peered":"2024-09-16T04:09:42.748467+0000","last_clean":"2024-09-16T04:09:42.748467+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:09:42.748467+0000","last_undegraded":"2024-09-16T04:09:42.748467+0000","last_fullsized":"2024-09-16T04:09:42.748467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:08.317815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:08.317815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.544247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:43.152046+0000","last_change":"2024-09-16T04:09:12.858831+0000","last_active":"2024-09-16T04:09:43.152046+0000","last_peered":"2024-09-16T04:09:43.152046+0000","last_clean":"2024-09-16T04:09:43.152046+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:43.152046+0000","last_undegraded":"2024-09-16T04:09:43.152046+0000","last_fullsized":"2024-09-16T04:09:43.152046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:12.858665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:12.858665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.829775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490988+0000","last_change":"2024-09-16T04:09:16.945224+0000","last_active":"2024-09-16T04:09:42.490988+0000","last_peered":"2024-09-16T04:09:42.490988+0000","last_clean":"2024-09-16T04:09:42.490988+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:42.490988+0000","last_undegraded":"2024-09-16T04:09:42.490988+0000","last_fullsized":"2024-09-16T04:09:42.490988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_clean_scrub_stamp":"2024-09-16T04:09:16.944907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.888239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313241,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28760,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343080,"statfs":{"total":96636764160,"available":96607313920,"internally_reserved":0,"allocated":1765376,"data_stored":1025632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280537,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33448,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338392,"statfs":{"total":96636764160,"available":96602513408,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280536,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247831,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33436,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338404,"statfs":{"total":96636764160,"available":96602525696,"internally_reserved":0,"allocated":2297856,"data_stored":1554560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247831,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:45.941 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:46.224 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:46.241 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-16T04:09:45.996828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":527988,"kb_used_data":28888,"kb_used_omap":24,"kb_used_meta":498663,"kb_avail":1509421452,"statfs":{"total":1546188226560,"available":1545647566848,"internally_reserved":0,"allocated":29581312,"data_stored":17621894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":510630991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001998"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":402,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678523+0000","last_change":"2024-09-16T04:09:23.019365+0000","last_active":"2024-09-16T04:09:42.678523+0000","last_peered":"2024-09-16T04:09:42.678523+0000","last_clean":"2024-09-16T04:09:42.678523+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:42.678523+0000","last_undegraded":"2024-09-16T04:09:42.678523+0000","last_fullsized":"2024-09-16T04:09:42.678523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_clean_scrub_stamp":"2024-09-16T04:09:23.019102+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:44.166795+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678575+0000","last_change":"2024-09-16T04:09:20.944577+0000","last_active":"2024-09-16T04:09:42.678575+0000","last_peered":"2024-09-16T04:09:42.678575+0000","last_clean":"2024-09-16T04:09:42.678575+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:42.678575+0000","last_undegraded":"2024-09-16T04:09:42.678575+0000","last_fullsized":"2024-09-16T04:09:42.678575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-16T04:09:20.944197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:20.944197+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:43.199430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.751368+0000","last_change":"2024-09-16T04:09:19.635816+0000","last_active":"2024-09-16T04:09:42.751368+0000","last_peered":"2024-09-16T04:09:42.751368+0000","last_clean":"2024-09-16T04:09:42.751368+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:42.751368+0000","last_undegraded":"2024-09-16T04:09:42.751368+0000","last_fullsized":"2024-09-16T04:09:42.751368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:19.635466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:19.635466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.106951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.785609+0000","last_change":"2024-09-16T04:09:14.986897+0000","last_active":"2024-09-16T04:09:42.785609+0000","last_peered":"2024-09-16T04:09:42.785609+0000","last_clean":"2024-09-16T04:09:42.785609+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:42.785609+0000","last_undegraded":"2024-09-16T04:09:42.785609+0000","last_fullsized":"2024-09-16T04:09:42.785609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_clean_scrub_stamp":"2024-09-16T04:09:14.986737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:42.504610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490986+0000","last_change":"2024-09-16T04:09:31.870143+0000","last_active":"2024-09-16T04:09:42.490986+0000","last_peered":"2024-09-16T04:09:42.490986+0000","last_clean":"2024-09-16T04:09:42.490986+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:42.490986+0000","last_undegraded":"2024-09-16T04:09:42.490986+0000","last_fullsized":"2024-09-16T04:09:42.490986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_clean_scrub_stamp":"2024-09-16T04:09:31.869801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:48.850138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.750480+0000","last_change":"2024-09-16T04:09:27.858245+0000","last_active":"2024-09-16T04:09:42.750480+0000","last_peered":"2024-09-16T04:09:42.750480+0000","last_clean":"2024-09-16T04:09:42.750480+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:42.750480+0000","last_undegraded":"2024-09-16T04:09:42.750480+0000","last_fullsized":"2024-09-16T04:09:42.750480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:27.857978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:27.857978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:40.872158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.748467+0000","last_change":"2024-09-16T04:09:11.352610+0000","last_active":"2024-09-16T04:09:42.748467+0000","last_peered":"2024-09-16T04:09:42.748467+0000","last_clean":"2024-09-16T04:09:42.748467+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:09:42.748467+0000","last_undegraded":"2024-09-16T04:09:42.748467+0000","last_fullsized":"2024-09-16T04:09:42.748467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:08.317815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:08.317815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.544247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:43.152046+0000","last_change":"2024-09-16T04:09:12.858831+0000","last_active":"2024-09-16T04:09:43.152046+0000","last_peered":"2024-09-16T04:09:43.152046+0000","last_clean":"2024-09-16T04:09:43.152046+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:43.152046+0000","last_undegraded":"2024-09-16T04:09:43.152046+0000","last_fullsized":"2024-09-16T04:09:43.152046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:12.858665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:12.858665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.829775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490988+0000","last_change":"2024-09-16T04:09:16.945224+0000","last_active":"2024-09-16T04:09:42.490988+0000","last_peered":"2024-09-16T04:09:42.490988+0000","last_clean":"2024-09-16T04:09:42.490988+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:42.490988+0000","last_undegraded":"2024-09-16T04:09:42.490988+0000","last_fullsized":"2024-09-16T04:09:42.490988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_clean_scrub_stamp":"2024-09-16T04:09:16.944907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.888239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313241,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280538,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33448,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338392,"statfs":{"total":96636764160,"available":96602513408,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280537,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247832,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37616,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334224,"statfs":{"total":96636764160,"available":96598245376,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:46.242 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T04:09:46.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:46.540 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:46.541 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:46.559 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-16T04:09:45.996828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":527988,"kb_used_data":28888,"kb_used_omap":24,"kb_used_meta":498663,"kb_avail":1509421452,"statfs":{"total":1546188226560,"available":1545647566848,"internally_reserved":0,"allocated":29581312,"data_stored":17621894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":510630991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001998"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":402,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678523+0000","last_change":"2024-09-16T04:09:23.019365+0000","last_active":"2024-09-16T04:09:42.678523+0000","last_peered":"2024-09-16T04:09:42.678523+0000","last_clean":"2024-09-16T04:09:42.678523+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:42.678523+0000","last_undegraded":"2024-09-16T04:09:42.678523+0000","last_fullsized":"2024-09-16T04:09:42.678523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_clean_scrub_stamp":"2024-09-16T04:09:23.019102+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:44.166795+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678575+0000","last_change":"2024-09-16T04:09:20.944577+0000","last_active":"2024-09-16T04:09:42.678575+0000","last_peered":"2024-09-16T04:09:42.678575+0000","last_clean":"2024-09-16T04:09:42.678575+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:42.678575+0000","last_undegraded":"2024-09-16T04:09:42.678575+0000","last_fullsized":"2024-09-16T04:09:42.678575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-16T04:09:20.944197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:20.944197+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:43.199430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.751368+0000","last_change":"2024-09-16T04:09:19.635816+0000","last_active":"2024-09-16T04:09:42.751368+0000","last_peered":"2024-09-16T04:09:42.751368+0000","last_clean":"2024-09-16T04:09:42.751368+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:42.751368+0000","last_undegraded":"2024-09-16T04:09:42.751368+0000","last_fullsized":"2024-09-16T04:09:42.751368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:19.635466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:19.635466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.106951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.785609+0000","last_change":"2024-09-16T04:09:14.986897+0000","last_active":"2024-09-16T04:09:42.785609+0000","last_peered":"2024-09-16T04:09:42.785609+0000","last_clean":"2024-09-16T04:09:42.785609+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:42.785609+0000","last_undegraded":"2024-09-16T04:09:42.785609+0000","last_fullsized":"2024-09-16T04:09:42.785609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_clean_scrub_stamp":"2024-09-16T04:09:14.986737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:42.504610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490986+0000","last_change":"2024-09-16T04:09:31.870143+0000","last_active":"2024-09-16T04:09:42.490986+0000","last_peered":"2024-09-16T04:09:42.490986+0000","last_clean":"2024-09-16T04:09:42.490986+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:42.490986+0000","last_undegraded":"2024-09-16T04:09:42.490986+0000","last_fullsized":"2024-09-16T04:09:42.490986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_clean_scrub_stamp":"2024-09-16T04:09:31.869801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:48.850138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.750480+0000","last_change":"2024-09-16T04:09:27.858245+0000","last_active":"2024-09-16T04:09:42.750480+0000","last_peered":"2024-09-16T04:09:42.750480+0000","last_clean":"2024-09-16T04:09:42.750480+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:42.750480+0000","last_undegraded":"2024-09-16T04:09:42.750480+0000","last_fullsized":"2024-09-16T04:09:42.750480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:27.857978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:27.857978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:40.872158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.748467+0000","last_change":"2024-09-16T04:09:11.352610+0000","last_active":"2024-09-16T04:09:42.748467+0000","last_peered":"2024-09-16T04:09:42.748467+0000","last_clean":"2024-09-16T04:09:42.748467+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:09:42.748467+0000","last_undegraded":"2024-09-16T04:09:42.748467+0000","last_fullsized":"2024-09-16T04:09:42.748467+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:08.317815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:08.317815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.544247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:43.152046+0000","last_change":"2024-09-16T04:09:12.858831+0000","last_active":"2024-09-16T04:09:43.152046+0000","last_peered":"2024-09-16T04:09:43.152046+0000","last_clean":"2024-09-16T04:09:43.152046+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:43.152046+0000","last_undegraded":"2024-09-16T04:09:43.152046+0000","last_fullsized":"2024-09-16T04:09:43.152046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:12.858665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:12.858665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.829775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490988+0000","last_change":"2024-09-16T04:09:16.945224+0000","last_active":"2024-09-16T04:09:42.490988+0000","last_peered":"2024-09-16T04:09:42.490988+0000","last_clean":"2024-09-16T04:09:42.490988+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:42.490988+0000","last_undegraded":"2024-09-16T04:09:42.490988+0000","last_fullsized":"2024-09-16T04:09:42.490988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_clean_scrub_stamp":"2024-09-16T04:09:16.944907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.888239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313241,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280538,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33448,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338392,"statfs":{"total":96636764160,"available":96602513408,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280537,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247832,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37616,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334224,"statfs":{"total":96636764160,"available":96598245376,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247832,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:46.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T04:09:46.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:46.863 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":119,"fsid":"d778dcff-91d6-4620-92b2-10f7b308093f","created":"2024-09-16T04:07:45.122757+0000","modified":"2024-09-16T04:09:42.256505+0000","last_up_change":"2024-09-16T04:07:59.656211+0000","last_in_change":"2024-09-16T04:09:09.950161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T04:08:00.056722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T04:08:00.124851+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":27,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.0100002288818359,"score_stable":4.0100002288818359,"optimal_score":0.81000000238418579,"raw_score_acting":3.25,"raw_score_stable":3.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"772dd30d-adce-4356-af08-b3b736f76522","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6801","nonce":2437639111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6803","nonce":2437639111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6807","nonce":2437639111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2437639111},{"type":"v1","addr":"172.21.15.32:6805","nonce":2437639111}]},"public_addr":"172.21.15.32:6801/2437639111","cluster_addr":"172.21.15.32:6803/2437639111","heartbeat_back_addr":"172.21.15.32:6807/2437639111","heartbeat_front_addr":"172.21.15.32:6805/2437639111","state":["exists","up"]},{"osd":1,"uuid":"4d1f3ec3-2122-4c73-88b8-5592b6018cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6801","nonce":3350291568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6803","nonce":3350291568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6807","nonce":3350291568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3350291568},{"type":"v1","addr":"172.21.15.50:6805","nonce":3350291568}]},"public_addr":"172.21.15.50:6801/3350291568","cluster_addr":"172.21.15.50:6803/3350291568","heartbeat_back_addr":"172.21.15.50:6807/3350291568","heartbeat_front_addr":"172.21.15.50:6805/3350291568","state":["exists","up"]},{"osd":2,"uuid":"c43581d9-7f5c-4add-b701-3d4ca819cc21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6809","nonce":1937499112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6811","nonce":1937499112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6815","nonce":1937499112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1937499112},{"type":"v1","addr":"172.21.15.196:6813","nonce":1937499112}]},"public_addr":"172.21.15.196:6809/1937499112","cluster_addr":"172.21.15.196:6811/1937499112","heartbeat_back_addr":"172.21.15.196:6815/1937499112","heartbeat_front_addr":"172.21.15.196:6813/1937499112","state":["exists","up"]},{"osd":3,"uuid":"5f8be370-dca7-4e97-9881-ebe2844d921e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6811","nonce":3432709838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6813","nonce":3432709838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6817","nonce":3432709838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":3432709838},{"type":"v1","addr":"172.21.15.204:6815","nonce":3432709838}]},"public_addr":"172.21.15.204:6811/3432709838","cluster_addr":"172.21.15.204:6813/3432709838","heartbeat_back_addr":"172.21.15.204:6817/3432709838","heartbeat_front_addr":"172.21.15.204:6815/3432709838","state":["exists","up"]},{"osd":4,"uuid":"c379bcc8-87f2-4f46-bec9-0ffba89178d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6817","nonce":2357479946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6819","nonce":2357479946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6823","nonce":2357479946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2357479946},{"type":"v1","addr":"172.21.15.32:6821","nonce":2357479946}]},"public_addr":"172.21.15.32:6817/2357479946","cluster_addr":"172.21.15.32:6819/2357479946","heartbeat_back_addr":"172.21.15.32:6823/2357479946","heartbeat_front_addr":"172.21.15.32:6821/2357479946","state":["exists","up"]},{"osd":5,"uuid":"a973a162-2635-40c6-877d-af5305b3009e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6825","nonce":1697829187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6827","nonce":1697829187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6831","nonce":1697829187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1697829187},{"type":"v1","addr":"172.21.15.50:6829","nonce":1697829187}]},"public_addr":"172.21.15.50:6825/1697829187","cluster_addr":"172.21.15.50:6827/1697829187","heartbeat_back_addr":"172.21.15.50:6831/1697829187","heartbeat_front_addr":"172.21.15.50:6829/1697829187","state":["exists","up"]},{"osd":6,"uuid":"45f16fc0-11df-42cc-be0e-4c5121d77bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6817","nonce":2251260649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6819","nonce":2251260649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6823","nonce":2251260649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2251260649},{"type":"v1","addr":"172.21.15.196:6821","nonce":2251260649}]},"public_addr":"172.21.15.196:6817/2251260649","cluster_addr":"172.21.15.196:6819/2251260649","heartbeat_back_addr":"172.21.15.196:6823/2251260649","heartbeat_front_addr":"172.21.15.196:6821/2251260649","state":["exists","up"]},{"osd":7,"uuid":"3ae2fec7-73aa-4a64-8e60-2708cf125e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6819","nonce":713727456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6821","nonce":713727456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6825","nonce":713727456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":713727456},{"type":"v1","addr":"172.21.15.204:6823","nonce":713727456}]},"public_addr":"172.21.15.204:6819/713727456","cluster_addr":"172.21.15.204:6821/713727456","heartbeat_back_addr":"172.21.15.204:6825/713727456","heartbeat_front_addr":"172.21.15.204:6823/713727456","state":["exists","up"]},{"osd":8,"uuid":"66723a2f-fea1-4f58-8a13-4975a1246b3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6809","nonce":3629130261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6811","nonce":3629130261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6815","nonce":3629130261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3629130261},{"type":"v1","addr":"172.21.15.32:6813","nonce":3629130261}]},"public_addr":"172.21.15.32:6809/3629130261","cluster_addr":"172.21.15.32:6811/3629130261","heartbeat_back_addr":"172.21.15.32:6815/3629130261","heartbeat_front_addr":"172.21.15.32:6813/3629130261","state":["exists","up"]},{"osd":9,"uuid":"c5748e2c-4ba4-4375-9eef-4f94700b757d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6809","nonce":3996914979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6811","nonce":3996914979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6815","nonce":3996914979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3996914979},{"type":"v1","addr":"172.21.15.50:6813","nonce":3996914979}]},"public_addr":"172.21.15.50:6809/3996914979","cluster_addr":"172.21.15.50:6811/3996914979","heartbeat_back_addr":"172.21.15.50:6815/3996914979","heartbeat_front_addr":"172.21.15.50:6813/3996914979","state":["exists","up"]},{"osd":10,"uuid":"b237a4a6-bd4a-4a81-a614-e4a3630fea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6801","nonce":2207776686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6803","nonce":2207776686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6807","nonce":2207776686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2207776686},{"type":"v1","addr":"172.21.15.196:6805","nonce":2207776686}]},"public_addr":"172.21.15.196:6801/2207776686","cluster_addr":"172.21.15.196:6803/2207776686","heartbeat_back_addr":"172.21.15.196:6807/2207776686","heartbeat_front_addr":"172.21.15.196:6805/2207776686","state":["exists","up"]},{"osd":11,"uuid":"63044142-acbb-4bdc-a74e-35bc92551e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6827","nonce":3659784481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6829","nonce":3659784481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6833","nonce":3659784481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":3659784481},{"type":"v1","addr":"172.21.15.204:6831","nonce":3659784481}]},"public_addr":"172.21.15.204:6827/3659784481","cluster_addr":"172.21.15.204:6829/3659784481","heartbeat_back_addr":"172.21.15.204:6833/3659784481","heartbeat_front_addr":"172.21.15.204:6831/3659784481","state":["exists","up"]},{"osd":12,"uuid":"1bdce88f-939d-40e3-bee0-9a99c41df477","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6825","nonce":1789797848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6827","nonce":1789797848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6831","nonce":1789797848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1789797848},{"type":"v1","addr":"172.21.15.32:6829","nonce":1789797848}]},"public_addr":"172.21.15.32:6825/1789797848","cluster_addr":"172.21.15.32:6827/1789797848","heartbeat_back_addr":"172.21.15.32:6831/1789797848","heartbeat_front_addr":"172.21.15.32:6829/1789797848","state":["exists","up"]},{"osd":13,"uuid":"88d92110-ec36-4bad-917b-aae13a69c4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6817","nonce":1556414646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6819","nonce":1556414646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6823","nonce":1556414646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1556414646},{"type":"v1","addr":"172.21.15.50:6821","nonce":1556414646}]},"public_addr":"172.21.15.50:6817/1556414646","cluster_addr":"172.21.15.50:6819/1556414646","heartbeat_back_addr":"172.21.15.50:6823/1556414646","heartbeat_front_addr":"172.21.15.50:6821/1556414646","state":["exists","up"]},{"osd":14,"uuid":"b8b37904-bb6e-435e-b90c-9a5ebb70e2b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6825","nonce":3322576165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6827","nonce":3322576165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6831","nonce":3322576165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3322576165},{"type":"v1","addr":"172.21.15.196:6829","nonce":3322576165}]},"public_addr":"172.21.15.196:6825/3322576165","cluster_addr":"172.21.15.196:6827/3322576165","heartbeat_back_addr":"172.21.15.196:6831/3322576165","heartbeat_front_addr":"172.21.15.196:6829/3322576165","state":["exists","up"]},{"osd":15,"uuid":"92df4e5f-b365-4c0b-ad9c-8af261cb4cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6803","nonce":4287478944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6805","nonce":4287478944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6809","nonce":4287478944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":4287478944},{"type":"v1","addr":"172.21.15.204:6807","nonce":4287478944}]},"public_addr":"172.21.15.204:6803/4287478944","cluster_addr":"172.21.15.204:6805/4287478944","heartbeat_back_addr":"172.21.15.204:6809/4287478944","heartbeat_front_addr":"172.21.15.204:6807/4287478944","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:06.947713+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:27.105222+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:25.623618+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:00.147346+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.536144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:16.340857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.487279+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:03.732168+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:02.265781+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:15.416849+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:15.452794+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:22.861739+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:16.226440+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:08:59.138963+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:11.738538+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T04:09:10.960319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":21,"length":1},{"begin":23,"length":1},{"begin":26,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T04:09:47.882 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T04:09:47.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:48.049 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:48.050 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:48.050 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:48.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T04:09:48.369 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T04:09:48.388 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T04:09:48.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:48.538 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:48.539 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:48.539 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:48.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T04:09:48.857 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T04:09:48.876 INFO:tasks.ceph:Scrubbing osd.8 2024-09-16T04:09:48.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:49.031 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:49.031 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:49.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-09-16T04:09:49.343 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 8 to deep-scrub 2024-09-16T04:09:49.361 INFO:tasks.ceph:Scrubbing osd.12 2024-09-16T04:09:49.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:49.508 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:49.508 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:49.508 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:49.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2024-09-16T04:09:49.818 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 12 to deep-scrub 2024-09-16T04:09:49.836 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T04:09:49.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:49.993 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:49.993 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:50.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T04:09:50.304 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T04:09:50.324 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T04:09:50.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:50.476 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:50.477 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:50.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T04:09:50.789 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T04:09:50.808 INFO:tasks.ceph:Scrubbing osd.9 2024-09-16T04:09:50.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:50.966 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:50.966 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:50.966 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:50.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-09-16T04:09:51.280 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 9 to deep-scrub 2024-09-16T04:09:51.299 INFO:tasks.ceph:Scrubbing osd.13 2024-09-16T04:09:51.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:51.457 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:51.457 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:51.458 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:51.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2024-09-16T04:09:51.777 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 13 to deep-scrub 2024-09-16T04:09:51.797 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T04:09:51.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:51.959 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:51.959 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:51.959 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:51.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T04:09:52.273 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T04:09:52.291 INFO:tasks.ceph:Scrubbing osd.6 2024-09-16T04:09:52.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:52.446 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:52.446 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:52.446 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:52.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-16T04:09:52.753 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2024-09-16T04:09:52.772 INFO:tasks.ceph:Scrubbing osd.10 2024-09-16T04:09:52.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:52.932 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:52.932 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:52.948 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-09-16T04:09:53.230 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 10 to deep-scrub 2024-09-16T04:09:53.248 INFO:tasks.ceph:Scrubbing osd.14 2024-09-16T04:09:53.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:53.402 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:53.402 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:53.402 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:53.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2024-09-16T04:09:53.697 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 14 to deep-scrub 2024-09-16T04:09:53.715 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T04:09:53.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:53.874 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:53.874 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:53.874 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:53.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T04:09:54.184 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T04:09:54.201 INFO:tasks.ceph:Scrubbing osd.7 2024-09-16T04:09:54.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:54.348 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:54.348 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:54.349 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:54.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-16T04:09:54.663 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2024-09-16T04:09:54.682 INFO:tasks.ceph:Scrubbing osd.11 2024-09-16T04:09:54.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:54.827 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:54.827 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:54.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-09-16T04:09:55.129 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 11 to deep-scrub 2024-09-16T04:09:55.148 INFO:tasks.ceph:Scrubbing osd.15 2024-09-16T04:09:55.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2024-09-16T04:09:55.292 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-16T04:09:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T04:09:55.292 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-16T04:09:55.307 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2024-09-16T04:09:55.593 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 15 to deep-scrub 2024-09-16T04:09:55.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:09:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:09:55.899 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:09:55.916 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-16T04:09:53.999177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":527976,"kb_used_data":28888,"kb_used_omap":24,"kb_used_meta":498663,"kb_avail":1509421464,"statfs":{"total":1546188226560,"available":1545647579136,"internally_reserved":0,"allocated":29581312,"data_stored":17621894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":510630991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.738699"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":402,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678523+0000","last_change":"2024-09-16T04:09:23.019365+0000","last_active":"2024-09-16T04:09:42.678523+0000","last_peered":"2024-09-16T04:09:42.678523+0000","last_clean":"2024-09-16T04:09:42.678523+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:09:42.678523+0000","last_undegraded":"2024-09-16T04:09:42.678523+0000","last_fullsized":"2024-09-16T04:09:42.678523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:23.019102+0000","last_clean_scrub_stamp":"2024-09-16T04:09:23.019102+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:44.166795+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.678575+0000","last_change":"2024-09-16T04:09:20.944577+0000","last_active":"2024-09-16T04:09:42.678575+0000","last_peered":"2024-09-16T04:09:42.678575+0000","last_clean":"2024-09-16T04:09:42.678575+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:09:42.678575+0000","last_undegraded":"2024-09-16T04:09:42.678575+0000","last_fullsized":"2024-09-16T04:09:42.678575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-16T04:09:20.944197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:20.944197+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:43.199430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.751368+0000","last_change":"2024-09-16T04:09:19.635816+0000","last_active":"2024-09-16T04:09:42.751368+0000","last_peered":"2024-09-16T04:09:42.751368+0000","last_clean":"2024-09-16T04:09:42.751368+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:09:42.751368+0000","last_undegraded":"2024-09-16T04:09:42.751368+0000","last_fullsized":"2024-09-16T04:09:42.751368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:19.635466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:19.635466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:33.106951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.785609+0000","last_change":"2024-09-16T04:09:14.986897+0000","last_active":"2024-09-16T04:09:42.785609+0000","last_peered":"2024-09-16T04:09:42.785609+0000","last_clean":"2024-09-16T04:09:42.785609+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:09:42.785609+0000","last_undegraded":"2024-09-16T04:09:42.785609+0000","last_fullsized":"2024-09-16T04:09:42.785609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:14.986737+0000","last_clean_scrub_stamp":"2024-09-16T04:09:14.986737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:42.504610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490986+0000","last_change":"2024-09-16T04:09:31.870143+0000","last_active":"2024-09-16T04:09:42.490986+0000","last_peered":"2024-09-16T04:09:42.490986+0000","last_clean":"2024-09-16T04:09:42.490986+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:09:42.490986+0000","last_undegraded":"2024-09-16T04:09:42.490986+0000","last_fullsized":"2024-09-16T04:09:42.490986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:31.869801+0000","last_clean_scrub_stamp":"2024-09-16T04:09:31.869801+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:48.850138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.750480+0000","last_change":"2024-09-16T04:09:27.858245+0000","last_active":"2024-09-16T04:09:42.750480+0000","last_peered":"2024-09-16T04:09:42.750480+0000","last_clean":"2024-09-16T04:09:42.750480+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:09:42.750480+0000","last_undegraded":"2024-09-16T04:09:42.750480+0000","last_fullsized":"2024-09-16T04:09:42.750480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:27.857978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:27.857978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:40.872158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:49.483365+0000","last_change":"2024-09-16T04:09:49.483395+0000","last_active":"2024-09-16T04:09:49.483365+0000","last_peered":"2024-09-16T04:09:49.483365+0000","last_clean":"2024-09-16T04:09:49.483365+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:09:49.483365+0000","last_undegraded":"2024-09-16T04:09:49.483365+0000","last_fullsized":"2024-09-16T04:09:49.483365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:49.483252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:49.483252+0000","last_clean_scrub_stamp":"2024-09-16T04:09:49.483252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:56.142150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":206,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:43.152046+0000","last_change":"2024-09-16T04:09:12.858831+0000","last_active":"2024-09-16T04:09:43.152046+0000","last_peered":"2024-09-16T04:09:43.152046+0000","last_clean":"2024-09-16T04:09:43.152046+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:09:43.152046+0000","last_undegraded":"2024-09-16T04:09:43.152046+0000","last_fullsized":"2024-09-16T04:09:43.152046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:12.858665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:08:00.660153+0000","last_clean_scrub_stamp":"2024-09-16T04:09:12.858665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.829775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-16T04:09:42.490988+0000","last_change":"2024-09-16T04:09:16.945224+0000","last_active":"2024-09-16T04:09:42.490988+0000","last_peered":"2024-09-16T04:09:42.490988+0000","last_clean":"2024-09-16T04:09:42.490988+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:09:42.490988+0000","last_undegraded":"2024-09-16T04:09:42.490988+0000","last_fullsized":"2024-09-16T04:09:42.490988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:16.944907+0000","last_clean_scrub_stamp":"2024-09-16T04:09:16.944907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:29.888239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313243,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280538,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280539,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280539,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33448,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338392,"statfs":{"total":96636764160,"available":96602513408,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280538,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1035269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247833,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37616,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334224,"statfs":{"total":96636764160,"available":96598245376,"internally_reserved":0,"allocated":2314240,"data_stored":1564178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247835,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247834,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247833,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:09:55.922 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T04:09:23.019102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.922 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T04:09:20.944197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=20, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.922 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T04:09:19.635466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=19, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.923 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T04:09:14.986737+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=14, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.923 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T04:09:31.869801+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.923 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T04:09:27.857978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=27, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.923 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T04:09:12.858665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.923 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T04:09:16.944907+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=16, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=4, tm_min=9, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T04:09:55.923 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T04:10:15.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T04:10:16.246 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-16T04:10:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-16T04:10:16.265 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-16T04:10:16.005586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":13,"kb":1509949440,"kb_used":528196,"kb_used_data":29176,"kb_used_omap":24,"kb_used_meta":498663,"kb_avail":1509421244,"statfs":{"total":1546188226560,"available":1545647353856,"internally_reserved":0,"allocated":29876224,"data_stored":17795974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25521,"internal_metadata":510630991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001763"},"pg_stats":[{"pgid":"1.0","version":"99'159","reported_seq":414,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-16T04:10:13.288054+0000","last_change":"2024-09-16T04:09:56.970143+0000","last_active":"2024-09-16T04:10:13.288054+0000","last_peered":"2024-09-16T04:10:13.288054+0000","last_clean":"2024-09-16T04:10:13.288054+0000","last_became_active":"2024-09-16T04:08:01.757600+0000","last_became_peered":"2024-09-16T04:08:01.757600+0000","last_unstale":"2024-09-16T04:10:13.288054+0000","last_undegraded":"2024-09-16T04:10:13.288054+0000","last_fullsized":"2024-09-16T04:10:13.288054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-09-16T04:09:56.969891+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-09-16T04:09:56.969891+0000","last_clean_scrub_stamp":"2024-09-16T04:09:56.969891+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:11:17.607950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"119'2","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-16T04:10:13.288086+0000","last_change":"2024-09-16T04:09:56.008410+0000","last_active":"2024-09-16T04:10:13.288086+0000","last_peered":"2024-09-16T04:10:13.288086+0000","last_clean":"2024-09-16T04:10:13.288086+0000","last_became_active":"2024-09-16T04:08:01.756242+0000","last_became_peered":"2024-09-16T04:08:01.756242+0000","last_unstale":"2024-09-16T04:10:13.288086+0000","last_undegraded":"2024-09-16T04:10:13.288086+0000","last_fullsized":"2024-09-16T04:10:13.288086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'2","last_scrub_stamp":"2024-09-16T04:09:56.008073+0000","last_deep_scrub":"119'2","last_deep_scrub_stamp":"2024-09-16T04:09:56.008073+0000","last_clean_scrub_stamp":"2024-09-16T04:09:56.008073+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:57.212357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00047142100000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-16T04:10:13.289108+0000","last_change":"2024-09-16T04:09:51.512058+0000","last_active":"2024-09-16T04:10:13.289108+0000","last_peered":"2024-09-16T04:10:13.289108+0000","last_clean":"2024-09-16T04:10:13.289108+0000","last_became_active":"2024-09-16T04:08:01.762961+0000","last_became_peered":"2024-09-16T04:08:01.762961+0000","last_unstale":"2024-09-16T04:10:13.289108+0000","last_undegraded":"2024-09-16T04:10:13.289108+0000","last_fullsized":"2024-09-16T04:10:13.289108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:51.511804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:51.511804+0000","last_clean_scrub_stamp":"2024-09-16T04:09:51.511804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:56.697207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00048233199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":222,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-16T04:10:15.241193+0000","last_change":"2024-09-16T04:09:55.696410+0000","last_active":"2024-09-16T04:10:15.241193+0000","last_peered":"2024-09-16T04:10:15.241193+0000","last_clean":"2024-09-16T04:10:15.241193+0000","last_became_active":"2024-09-16T04:08:01.682544+0000","last_became_peered":"2024-09-16T04:08:01.682544+0000","last_unstale":"2024-09-16T04:10:15.241193+0000","last_undegraded":"2024-09-16T04:10:15.241193+0000","last_fullsized":"2024-09-16T04:10:15.241193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:55.696169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:55.696169+0000","last_clean_scrub_stamp":"2024-09-16T04:09:55.696169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:11:25.508205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077950000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"107'3","reported_seq":225,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T04:10:14.108040+0000","last_change":"2024-09-16T04:09:52.898731+0000","last_active":"2024-09-16T04:10:14.108040+0000","last_peered":"2024-09-16T04:10:14.108040+0000","last_clean":"2024-09-16T04:10:14.108040+0000","last_became_active":"2024-09-16T04:08:01.759759+0000","last_became_peered":"2024-09-16T04:08:01.759759+0000","last_unstale":"2024-09-16T04:10:14.108040+0000","last_undegraded":"2024-09-16T04:10:14.108040+0000","last_fullsized":"2024-09-16T04:10:14.108040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'3","last_scrub_stamp":"2024-09-16T04:09:52.898476+0000","last_deep_scrub":"107'3","last_deep_scrub_stamp":"2024-09-16T04:09:52.898476+0000","last_clean_scrub_stamp":"2024-09-16T04:09:52.898476+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:11:01.382753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000773948,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":222,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-16T04:10:15.297337+0000","last_change":"2024-09-16T04:09:52.924803+0000","last_active":"2024-09-16T04:10:15.297337+0000","last_peered":"2024-09-16T04:10:15.297337+0000","last_clean":"2024-09-16T04:10:15.297337+0000","last_became_active":"2024-09-16T04:08:01.759719+0000","last_became_peered":"2024-09-16T04:08:01.759719+0000","last_unstale":"2024-09-16T04:10:15.297337+0000","last_undegraded":"2024-09-16T04:10:15.297337+0000","last_fullsized":"2024-09-16T04:10:15.297337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:52.924569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:52.924569+0000","last_clean_scrub_stamp":"2024-09-16T04:09:52.924569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:11:08.954179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000795184,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,12],"acting":[6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-16T04:10:15.225606+0000","last_change":"2024-09-16T04:09:49.483395+0000","last_active":"2024-09-16T04:10:15.225606+0000","last_peered":"2024-09-16T04:10:15.225606+0000","last_clean":"2024-09-16T04:10:15.225606+0000","last_became_active":"2024-09-16T04:09:11.352033+0000","last_became_peered":"2024-09-16T04:09:11.352033+0000","last_unstale":"2024-09-16T04:10:15.225606+0000","last_undegraded":"2024-09-16T04:10:15.225606+0000","last_fullsized":"2024-09-16T04:10:15.225606+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:49.483252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:49.483252+0000","last_clean_scrub_stamp":"2024-09-16T04:09:49.483252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:10:56.142150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":221,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-16T04:10:15.117182+0000","last_change":"2024-09-16T04:09:54.013152+0000","last_active":"2024-09-16T04:10:15.117182+0000","last_peered":"2024-09-16T04:10:15.117182+0000","last_clean":"2024-09-16T04:10:15.117182+0000","last_became_active":"2024-09-16T04:08:01.758984+0000","last_became_peered":"2024-09-16T04:08:01.758984+0000","last_unstale":"2024-09-16T04:10:15.117182+0000","last_undegraded":"2024-09-16T04:10:15.117182+0000","last_fullsized":"2024-09-16T04:10:15.117182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:54.012911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:54.012911+0000","last_clean_scrub_stamp":"2024-09-16T04:09:54.012911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:11:10.684109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067663800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":222,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T04:10:14.108171+0000","last_change":"2024-09-16T04:09:51.919584+0000","last_active":"2024-09-16T04:10:14.108171+0000","last_peered":"2024-09-16T04:10:14.108171+0000","last_clean":"2024-09-16T04:10:14.108171+0000","last_became_active":"2024-09-16T04:08:01.679951+0000","last_became_peered":"2024-09-16T04:08:01.679951+0000","last_unstale":"2024-09-16T04:10:14.108171+0000","last_undegraded":"2024-09-16T04:10:14.108171+0000","last_fullsized":"2024-09-16T04:10:14.108171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T04:09:51.919272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T04:09:51.919272+0000","last_clean_scrub_stamp":"2024-09-16T04:09:51.919272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:11:21.613049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091288399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":13},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":23,"seq":98784247838,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,5,6,8,9,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":23,"seq":98784247839,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":23,"seq":98784247839,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313247,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28784,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343056,"statfs":{"total":96636764160,"available":96607289344,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1781760,"data_stored":1035250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28784,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343056,"statfs":{"total":96636764160,"available":96607289344,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28784,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343056,"statfs":{"total":96636764160,"available":96607289344,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,5,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1818624,"data_stored":1054639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280544,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33464,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338376,"statfs":{"total":96636764160,"available":96602497024,"internally_reserved":0,"allocated":2330624,"data_stored":1573838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,4,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1802240,"data_stored":1044929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247838,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2330624,"data_stored":1573838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247840,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32960,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1814528,"data_stored":1054620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":23,"seq":98784247838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32964,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1814528,"data_stored":1054620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":23,"seq":98784247839,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1814528,"data_stored":1054620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,7,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":23,"seq":98784247838,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1798144,"data_stored":1044910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T04:10:16.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T04:10:16.601 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T04:10:16.601 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T04:10:16.602 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T04:10:16.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:16.700 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T04:10:16.700 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T04:10:16.700 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:16.767 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T04:10:16.768 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-09-16T04:10:16.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:16.836 INFO:tasks.ceph.osd.8:Stopped 2024-09-16T04:10:16.837 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-09-16T04:10:16.837 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:16.915 INFO:tasks.ceph.osd.12:Stopped 2024-09-16T04:10:16.915 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T04:10:16.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.001 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T04:10:17.001 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T04:10:17.001 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.086 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T04:10:17.087 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-09-16T04:10:17.087 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.168 INFO:tasks.ceph.osd.9:Stopped 2024-09-16T04:10:17.168 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2024-09-16T04:10:17.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.259 INFO:tasks.ceph.osd.13:Stopped 2024-09-16T04:10:17.260 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T04:10:17.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.347 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T04:10:17.347 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-16T04:10:17.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.408 INFO:tasks.ceph.osd.6:Stopped 2024-09-16T04:10:17.408 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-09-16T04:10:17.409 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:17.483 INFO:tasks.ceph.osd.10:Stopped 2024-09-16T04:10:17.484 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-09-16T04:10:17.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:21.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2024-09-16T04:10:23.585 INFO:tasks.ceph.osd.14:Stopped 2024-09-16T04:10:23.586 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T04:10:23.586 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:23.648 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T04:10:23.649 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-16T04:10:23.649 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:27.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-16T04:10:27.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2024-09-16T04:10:29.750 INFO:tasks.ceph.osd.7:Stopped 2024-09-16T04:10:29.751 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-09-16T04:10:29.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:29.815 INFO:tasks.ceph.osd.11:Stopped 2024-09-16T04:10:29.816 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2024-09-16T04:10:29.816 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:29.913 INFO:tasks.ceph.osd.15:Stopped 2024-09-16T04:10:29.913 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T04:10:29.913 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T04:10:29.913 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:29.942 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T04:10:29.942 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T04:10:29.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:29.973 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T04:10:29.974 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T04:10:29.974 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T04:10:29.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:29.999 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T04:10:29.999 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T04:10:29.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:30.021 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T04:10:30.021 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T04:10:30.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T04:10:30.045 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T04:10:30.046 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T04:10:30.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'slow request' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-16T04:10:30.066 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:10:30.067 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T04:10:30.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:10:30.315 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T04:10:30.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:10:30.539 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-09-16T04:10:30.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:10:30.719 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2024-09-16T04:10:30.904 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:10:30.904 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T04:10:31.065 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:10:31.066 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T04:10:31.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:10:31.289 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-09-16T04:10:31.495 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:10:31.495 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2024-09-16T04:10:31.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:10:31.797 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T04:10:31.968 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:10:31.969 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T04:10:32.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-16T04:10:32.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:10:32.160 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-09-16T04:10:32.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:10:32.324 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2024-09-16T04:10:32.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:10:32.500 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T04:10:32.720 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:10:32.720 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T04:10:32.913 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:10:32.913 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-09-16T04:10:33.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:10:33.088 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2024-09-16T04:10:33.250 INFO:tasks.ceph:Archiving mon data... 2024-09-16T04:10:33.251 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/data/mon.a.tgz 2024-09-16T04:10:33.251 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-16T04:10:33.257 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.IsKIxLnJDf 2024-09-16T04:10:33.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IsKIxLnJDf 2024-09-16T04:10:33.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.IsKIxLnJDf 2024-09-16T04:10:33.496 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.IsKIxLnJDf is 554KB 2024-09-16T04:10:33.561 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.IsKIxLnJDf 2024-09-16T04:10:33.567 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/data/mon.b.tgz 2024-09-16T04:10:33.567 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-16T04:10:33.573 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.WdQIy4ldIQ 2024-09-16T04:10:33.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WdQIy4ldIQ 2024-09-16T04:10:33.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.WdQIy4ldIQ 2024-09-16T04:10:33.775 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.WdQIy4ldIQ is 387KB 2024-09-16T04:10:33.838 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.WdQIy4ldIQ 2024-09-16T04:10:33.843 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/data/mon.c.tgz 2024-09-16T04:10:33.844 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-09-16T04:10:33.849 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.Jdk0ztiOuq 2024-09-16T04:10:33.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Jdk0ztiOuq 2024-09-16T04:10:34.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.Jdk0ztiOuq 2024-09-16T04:10:34.086 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.Jdk0ztiOuq is 554KB 2024-09-16T04:10:34.153 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.Jdk0ztiOuq 2024-09-16T04:10:34.159 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T04:10:34.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T04:10:34.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T04:10:34.163 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T04:10:34.204 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T04:10:34.225 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T04:10:34.231 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T04:10:34.263 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T04:10:34.269 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T04:10:34.269 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T04:10:34.270 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi032/crash 2024-09-16T04:10:34.271 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T04:10:34.285 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi050/crash 2024-09-16T04:10:34.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T04:10:34.301 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi196/crash 2024-09-16T04:10:34.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T04:10:34.324 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi204/crash 2024-09-16T04:10:34.325 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T04:10:34.339 INFO:tasks.ceph:Compressing logs... 2024-09-16T04:10:34.339 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T04:10:34.342 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T04:10:34.348 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T04:10:34.362 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36715.log 2024-09-16T04:10:34.363 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-09-16T04:10:34.363 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37333.log 2024-09-16T04:10:34.363 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36715.log.gz 2024-09-16T04:10:34.364 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-09-16T04:10:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-09-16T04:10:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36533.log 2024-09-16T04:10:34.365 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37333.log.gz 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz --verbose 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.31469.log 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36533.log.gz 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33772.log 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31469.log.gz 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31293.log 2024-09-16T04:10:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-09-16T04:10:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-16T04:10:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T04:10:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T04:10:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T04:10:34.369 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-09-16T04:10:34.370 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2024-09-16T04:10:34.373 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-16T04:10:34.373 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.13.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T04:10:34.374 INFO:teuthology.orchestra.run.smithi050.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33772.log: /var/log/ceph/ceph-client.admin.31293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31293.log.gz 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33772.log.gz 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36429.log 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37386.log 2024-09-16T04:10:34.375 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36429.log.gz 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36983.log 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36221.log 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37386.log.gz 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36983.log.gz 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36094.log 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36221.log.gz 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38431.log 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36094.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.36094.log.gz -- 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.31887.log 2024-09-16T04:10:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32893.log 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38431.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31887.log: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33036.log 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.32893.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33036.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32325.log 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-09-16T04:10:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35612.log 2024-09-16T04:10:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32325.log.gz 2024-09-16T04:10:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-09-16T04:10:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T04:10:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35612.log.gz 2024-09-16T04:10:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-16T04:10:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34223.log 2024-09-16T04:10:34.385 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T04:10:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38665.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz -- 2024-09-16T04:10:34.388 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.31877.log 2024-09-16T04:10:34.388 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34223.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34879.log 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31337.log 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34879.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31895.log 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31337.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31895.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33981.log 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35543.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-09-16T04:10:34.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36689.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33981.log.gz 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36689.log.gz 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32903.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32747.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32903.log.gz 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32747.log.gz 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34138.log 2024-09-16T04:10:34.390 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34138.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33447.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36042.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31851.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.33447.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31851.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35747.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2024-09-16T04:10:34.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35747.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35190.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37472.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35190.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31448.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38197.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37472.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31448.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36741.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.38197.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36819.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38197.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36741.log.gz 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38821.log 2024-09-16T04:10:34.392 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31893.log 2024-09-16T04:10:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36819.log.gz 2024-09-16T04:10:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38821.log.gz 2024-09-16T04:10:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-09-16T04:10:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26256.log 2024-09-16T04:10:34.393 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-09-16T04:10:34.393 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33214.log 2024-09-16T04:10:34.394 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36793.log 2024-09-16T04:10:34.394 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26256.log.gz 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T04:10:34.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.10.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T04:10:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-09-16T04:10:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33214.log: /var/log/ceph/ceph-client.admin.36793.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.33214.log.gz 2024-09-16T04:10:34.429 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36793.log.gz 2024-09-16T04:10:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34643.log 2024-09-16T04:10:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34643.log.gz 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33607.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36043.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34355.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33607.log.gz 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36043.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36043.log.gz 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38405.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31857.log 2024-09-16T04:10:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34574.log 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38405.log.gz 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31857.log.gz 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38145.log 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34574.log.gz 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31910.log 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37355.log 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38145.log.gz 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31910.log.gz 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37425.log 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37355.log.gz 2024-09-16T04:10:34.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34188.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32379.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36247.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37425.log.gz 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32379.log.gz 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36247.log.gz 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31478.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38119.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz -- 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.34507.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34511.log 2024-09-16T04:10:34.432 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31478.log.gz 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32901.log 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.34507.log.gz 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32346.log 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34511.log.gz 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32901.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32901.log.gz /var/log/ceph/ceph-client.admin.31463.log 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-16T04:10:34.433 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33393.log/var/log/ceph/ceph-client.admin.32346.log: 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32346.log.gz 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32721.log 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31463.log.gz 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33393.log.gz 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36143.log 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36897.log 2024-09-16T04:10:34.434 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36143.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38613.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36990.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36897.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34908.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31245.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36990.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.34908.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31245.log.gz 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-09-16T04:10:34.435 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35293.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37400.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35293.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37400.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31454.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-09-16T04:10:34.436 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31454.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31481.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34428.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33659.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31481.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32277.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34428.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35856.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33659.log.gz 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2024-09-16T04:10:34.437 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32277.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34112.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35856.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38327.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31443.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34112.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37419.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38327.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38457.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31443.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37833.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37419.log.gz 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-09-16T04:10:34.438 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38457.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32284.log 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37833.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33096.log 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36095.log 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32284.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33096.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36095.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33338.log 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-09-16T04:10:34.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31453.log 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37911.log 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33338.log.gz 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36195.log 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31453.log.gz 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33828.log 0.0% 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37911.log.gz 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36195.log.gz 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33828.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33828.log.gz 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.35721.log 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-09-16T04:10:34.440 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37408.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35721.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35936.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37408.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37395.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33484.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35936.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35663.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37395.log.gz 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37006.log 2024-09-16T04:10:34.441 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33484.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31477.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.35663.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34053.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37006.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31477.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31886.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.34053.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36976.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31886.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35223.log 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36976.log.gz 2024-09-16T04:10:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26393.log 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.35223.log.gz 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26393.log.gz 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35079.log 2024-09-16T04:10:34.443 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-09-16T04:10:34.456 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26380.log 2024-09-16T04:10:34.456 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26507.log 2024-09-16T04:10:34.457 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26284.log 2024-09-16T04:10:34.457 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26380.log.gz 2024-09-16T04:10:34.457 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.26507.log: /var/log/ceph/ceph-osd.7.log 2024-09-16T04:10:34.459 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26507.log.gz 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26404.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26284.log.gz 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26556.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26580.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26404.log.gz 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26556.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26556.log.gz 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26236.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26580.log.gz 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr:gzip/var/log/ceph/ceph-client.admin.26236.log: -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2024-09-16T04:10:34.460 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26236.log.gz 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26531.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.15.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26332.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26356.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26531.log.gz 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26308.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26332.log.gz 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:gzip/var/log/ceph/ceph-client.admin.26356.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26435.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26356.log.gz 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26260.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26308.log.gz 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26604.log 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26435.log.gz 2024-09-16T04:10:34.461 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26260.log.gz 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26459.log 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26483.log 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26604.log.gz 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31790.log 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26459.log.gz 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26483.log.gz 2024-09-16T04:10:34.462 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.0.31790.log: 57.5% -- replaced with /var/log/ceph/ceph-client.0.31790.log.gz 2024-09-16T04:10:34.488 INFO:teuthology.orchestra.run.smithi204.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34482.log 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35079.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35079.log.gz --verbose 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.35467.log 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34482.log.gz 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35467.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35467.log.gz 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36325.log 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2024-09-16T04:10:34.490 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35049.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36325.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37009.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35049.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38301.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37009.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32336.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-09-16T04:10:34.491 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38301.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31472.log 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32336.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36455.log 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35074.log 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31472.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36455.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35638.log 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35074.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37385.log 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2024-09-16T04:10:34.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36351.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35638.log.gz 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34966.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37385.log.gz 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32398.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36351.log.gz 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36403.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 27.5% -- replaced with /var/log/ceph/ceph-client.admin.34966.log.gz 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35885.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32398.log.gz 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31470.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36403.log.gz 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36663.log 2024-09-16T04:10:34.493 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35885.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32253.log 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31470.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36986.log 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36663.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32825.log 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32253.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36986.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33684.log 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32825.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31845.log 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2024-09-16T04:10:34.494 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33684.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.33684.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36972.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31845.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37807.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36972.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34992.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32323.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37807.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34992.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.34992.log.gz 2024-09-16T04:10:34.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31480.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32323.log.gz 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31860.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31480.log.gz 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31860.log.gz 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38041.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38535.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37423.log 2024-09-16T04:10:34.496 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38041.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38535.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32390.log 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38535.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37423.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21409.log 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37423.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32390.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.21409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38275.log 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21409.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37389.log 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37000.log 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38275.log.gz 2024-09-16T04:10:34.497 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37389.log.gz 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37000.log.gz 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33367.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34273.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33367.log.gz 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33298.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34273.log.gz 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32669.log 2024-09-16T04:10:34.498 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33298.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38769.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32669.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35761.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38769.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35761.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.35761.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31270.log 2024-09-16T04:10:34.499 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33768.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36637.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31270.log.gz 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36169.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33768.log.gz 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33206.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36637.log.gz 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36169.log.gz 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33550.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33206.log.gz 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32894.log 2024-09-16T04:10:34.500 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.33550.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31369.log 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32894.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37781.log 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31369.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36974.log 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31873.log 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37781.log.gz 2024-09-16T04:10:34.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36299.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36974.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35372.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31873.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33699.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.36299.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31885.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35372.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32368.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33699.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37859.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31885.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37357.log 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32368.log.gz 2024-09-16T04:10:34.502 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36273.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37859.log.gz 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37357.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37357.log.gz 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36988.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36273.log.gz 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31876.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32404.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36988.log.gz 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34617.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31876.log.gz 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32404.log.gz 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31839.log 2024-09-16T04:10:34.503 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34617.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32855.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31839.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37007.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32855.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37005.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32855.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37007.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38093.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37005.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31447.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-09-16T04:10:34.504 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38093.log.gz 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31447.log.gz 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33125.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz/var/log/ceph/ceph-client.admin.38691.log: 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37001.log 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37001.log.gz 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37885.log 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-09-16T04:10:34.505 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35424.log 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33101.log: /var/log/ceph/ceph-client.admin.37885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33933.log 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37885.log.gz 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37411.log 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.35424.log.gz 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26510.log 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33933.log.gz 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31475.log 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37411.log.gz 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26510.log.gz 2024-09-16T04:10:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31475.log.gz 2024-09-16T04:10:34.536 INFO:teuthology.orchestra.run.smithi032.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T04:10:34.580 INFO:teuthology.orchestra.run.smithi196.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-16T04:10:34.630 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-09-16T04:10:34.638 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T04:10:34.640 INFO:teuthology.orchestra.run.smithi196.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T04:10:34.664 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-16T04:10:34.674 INFO:teuthology.orchestra.run.smithi204.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-16T04:10:34.917 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2024-09-16T04:10:34.980 INFO:teuthology.orchestra.run.smithi204.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-09-16T04:10:35.058 INFO:teuthology.orchestra.run.smithi196.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-09-16T04:10:35.126 INFO:teuthology.orchestra.run.smithi204.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T04:10:35.170 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T04:10:35.200 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-16T04:10:35.214 INFO:teuthology.orchestra.run.smithi196.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2024-09-16T04:10:35.247 INFO:teuthology.orchestra.run.smithi204.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2024-09-16T04:10:35.250 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-16T04:10:35.250 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m0.851s 2024-09-16T04:10:35.251 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m2.314s 2024-09-16T04:10:35.251 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m0.081s 2024-09-16T04:10:35.253 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-09-16T04:10:35.308 INFO:teuthology.orchestra.run.smithi196.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-16T04:10:35.309 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-16T04:10:35.310 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m0.928s 2024-09-16T04:10:35.310 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m2.712s 2024-09-16T04:10:35.310 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m0.106s 2024-09-16T04:10:35.378 INFO:teuthology.orchestra.run.smithi050.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-16T04:10:35.380 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-16T04:10:35.380 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m1.030s 2024-09-16T04:10:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m2.310s 2024-09-16T04:10:35.381 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.104s 2024-09-16T04:10:35.400 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2024-09-16T04:10:35.401 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-16T04:10:35.401 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m1.058s 2024-09-16T04:10:35.401 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m3.552s 2024-09-16T04:10:35.402 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m0.232s 2024-09-16T04:10:35.403 INFO:tasks.ceph:Archiving logs... 2024-09-16T04:10:35.404 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi032/log 2024-09-16T04:10:35.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T04:10:36.094 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi050/log 2024-09-16T04:10:36.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T04:10:36.407 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi196/log 2024-09-16T04:10:36.408 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T04:10:36.789 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi204/log 2024-09-16T04:10:36.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T04:10:37.148 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T04:10:37.157 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T04:10:37.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T04:10:37.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T04:10:37.165 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T04:10:37.168 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T04:10:37.281 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T04:10:37.290 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T04:10:37.291 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:10:37.293 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:10:37.296 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:10:37.298 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T04:10:37.304 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:10:37.304 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-16T04:10:37.304 INFO:teuthology.orchestra.run.smithi032.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 77 0.084 -0.007 1.399 2024-09-16T04:10:37.305 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 31 64 77 0.073 -2.088 1.053 2024-09-16T04:10:37.305 INFO:teuthology.orchestra.run.smithi032.stdout:*hv03.front.sepi 74.6.168.72 3 u 31 64 77 0.135 +0.505 1.652 2024-09-16T04:10:37.305 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:10:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:10:37.307 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-16T04:10:37.307 INFO:teuthology.orchestra.run.smithi050.stdout:*hv01.front.sepi 67.205.162.81 3 u 27 64 77 0.111 -0.718 1.431 2024-09-16T04:10:37.307 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 77 0.130 -2.191 1.576 2024-09-16T04:10:37.307 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 33 64 77 0.099 -0.356 1.628 2024-09-16T04:10:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:10:37.310 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:10:37.310 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-09-16T04:10:37.310 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 67.205.162.81 3 u 31 64 77 0.113 -0.122 1.449 2024-09-16T04:10:37.310 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 77 0.095 -1.550 1.406 2024-09-16T04:10:37.311 INFO:teuthology.orchestra.run.smithi196.stdout:+hv03.front.sepi 74.6.168.72 3 u 28 64 77 0.139 +0.193 1.529 2024-09-16T04:10:37.311 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:10:37.313 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T04:10:37.313 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2024-09-16T04:10:37.313 INFO:teuthology.orchestra.run.smithi204.stdout:*hv01.front.sepi 67.205.162.81 3 u 29 64 77 0.123 -0.107 0.561 2024-09-16T04:10:37.313 INFO:teuthology.orchestra.run.smithi204.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 77 0.093 -1.342 0.817 2024-09-16T04:10:37.314 INFO:teuthology.orchestra.run.smithi204.stdout:+hv03.front.sepi 74.6.168.72 3 u 32 64 77 0.087 -0.656 0.663 2024-09-16T04:10:37.314 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T04:10:37.315 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T04:10:37.325 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T04:10:37.325 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T04:10:37.336 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T04:10:37.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T04:10:37.353 INFO:teuthology.task.internal:Duration was 832.822927 seconds 2024-09-16T04:10:37.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T04:10:37.362 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T04:10:37.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T04:10:37.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T04:10:37.367 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T04:10:37.370 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T04:10:37.405 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T04:10:37.406 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-09-16T04:10:37.406 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T04:10:37.452 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-16T04:10:37.452 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T04:10:37.463 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-09-16T04:10:37.464 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T04:10:37.473 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-09-16T04:10:37.474 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T04:10:37.483 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T04:10:37.483 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T04:10:37.500 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T04:10:37.508 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T04:10:37.517 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T04:10:37.551 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T04:10:37.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T04:10:37.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T04:10:37.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T04:10:37.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T04:10:37.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T04:10:37.662 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T04:10:37.662 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T04:10:37.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T04:10:37.687 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T04:10:37.698 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T04:10:37.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T04:10:37.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.733 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-09-16T04:10:37.742 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.743 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-16T04:10:37.749 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-09-16T04:10:37.762 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-09-16T04:10:37.785 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:10:37.803 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:10:37.810 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:10:37.818 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:10:37.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T04:10:37.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T04:10:37.840 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T04:10:37.841 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi032 2024-09-16T04:10:37.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T04:10:37.868 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi050 2024-09-16T04:10:37.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T04:10:37.888 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi196 2024-09-16T04:10:37.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T04:10:37.912 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7905958/remote/smithi204 2024-09-16T04:10:37.912 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T04:10:37.932 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T04:10:37.933 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T04:10:37.935 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T04:10:37.937 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T04:10:37.952 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T04:10:37.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T04:10:37.990 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T04:10:37.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T04:10:38.003 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T04:10:38.003 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T04:10:38.006 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T04:10:38.008 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T04:10:38.009 INFO:teuthology.orchestra.run.smithi032.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 04:10 /home/ubuntu/cephtest 2024-09-16T04:10:38.011 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T04:10:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 04:10 /home/ubuntu/cephtest 2024-09-16T04:10:38.015 INFO:teuthology.orchestra.run.smithi196.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 04:10 /home/ubuntu/cephtest 2024-09-16T04:10:38.026 INFO:teuthology.orchestra.run.smithi204.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 04:10 /home/ubuntu/cephtest 2024-09-16T04:10:38.028 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T04:10:38.039 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T04:10:38.173 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} duration: 832.8229265213013 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T04:10:38.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T04:10:38.257 INFO:teuthology.run:pass